-- Logs begin at Tue 2022-07-26 03:43:49 UTC, end at Tue 2022-07-26 05:19:55 UTC. -- Jul 26 04:50:49.422932 dv-cinder-850574-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 04:50:49.433404 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 04:50:49 2022] *** Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: nodename: dv-cinder-850574-1-iscsi Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: machine: x86_64 Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: clock source: unix Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: pcre jit disabled Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: detected number of CPU cores: 4 Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: current working directory: / Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: detected binary path: /usr/bin/uwsgi-core Jul 26 04:50:49.434830 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: your processes number limit is 47680 Jul 26 04:50:49.435627 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: your memory page size is 4096 bytes Jul 26 04:50:49.435627 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: detected max file descriptor number: 2048 Jul 26 04:50:49.435627 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: lock engine: pthread robust mutexes Jul 26 04:50:49.435627 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: thunder lock: enabled Jul 26 04:50:49.435627 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 04:50:49.435627 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 04:50:49.473659 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: Python main interpreter initialized at 0x55cb850e79c0 Jul 26 04:50:49.473659 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: python threads support enabled Jul 26 04:50:49.473659 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: your server socket listen backlog is limited to 100 connections Jul 26 04:50:49.473659 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: your mercy for graceful operations on workers is 90 seconds Jul 26 04:50:49.474094 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 04:50:49.474094 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: *** Operational MODE: preforking *** Jul 26 04:50:49.474360 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: *** uWSGI is running in multiple interpreter mode *** Jul 26 04:50:49.474360 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: spawned uWSGI master process (pid: 103252) Jul 26 04:50:49.474597 dv-cinder-850574-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 04:50:49.475606 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: spawned uWSGI worker 1 (pid: 103253, cores: 1) Jul 26 04:50:49.475930 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: spawned uWSGI worker 2 (pid: 103254, cores: 1) Jul 26 04:50:49.476073 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 04:50:50.122353 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:50:50.136385 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:50:51.189074 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:50:51.189074 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: from cryptography.utils import int_from_bytes Jul 26 04:50:51.189826 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:50:51.189826 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: from cryptography.utils import int_from_bytes Jul 26 04:50:51.189826 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:50:51.189826 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: from cryptography.utils import int_from_bytes Jul 26 04:50:51.190354 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:50:51.190354 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: from cryptography.utils import int_from_bytes Jul 26 04:50:53.658708 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:50:53.659290 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:50:53.659397 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:50:53.659397 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:50:53.659845 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:50:53.659845 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:50:53.659982 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:50:53.660048 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:50:53.660123 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:50:53.660337 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.660436 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:50:53.660650 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.660752 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.660973 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.661071 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.661302 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.661461 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.661598 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.661707 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.661918 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.662066 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.662225 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.662370 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.662503 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.662614 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.662817 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.662923 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.663093 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.663236 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.663380 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.663490 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.663726 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.663857 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850574-1-iscsi {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.664028 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.664158 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850574-1-iscsi {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.664314 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.664407 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.664614 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.664710 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.664915 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.665003 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.665209 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.665299 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.665499 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.665587 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.665797 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.665895 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.666104 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.666274 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.666584 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.666732 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.666881 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.667022 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.667219 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.667347 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.667453 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.667588 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.667787 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.667922 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.668107 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.668235 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.668414 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.668549 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.668714 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.668850 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.669023 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.669155 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.669337 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.669471 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.669606 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.669730 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850574-1-iscsi {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.670019 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.670145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850574-1-iscsi {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.670319 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.670454 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.670607 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.670737 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.670922 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.671192 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.671335 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.671464 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.671673 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.671812 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.671992 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.672120 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.672294 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.672500 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.672624 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.672745 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.672880 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.673071 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.673198 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.673339 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.673462 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.673589 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.673779 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.673916 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.674048 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.674169 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.674355 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.674483 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.674655 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.674781 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.674947 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.675082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.675234 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.675360 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.675541 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.675689 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.675825 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.675950 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.676070 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.676196 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.676373 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.676507 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.676686 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.676814 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.676996 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.677138 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.677274 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.677481 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.677618 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.677742 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.677863 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.677983 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.678126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.678256 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.678387 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.678516 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.678639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.678768 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.678898 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.679029 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.679151 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.679271 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.679456 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.679610 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.679758 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.679892 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.680071 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.680199 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.680361 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.680497 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.680680 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.680808 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.680990 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.681118 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.681290 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.681426 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.681578 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.681713 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.681894 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.682021 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.682203 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.682341 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.682493 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.682627 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.682799 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.682934 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.683070 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.683267 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.683404 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.683536 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.683698 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.683820 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.684019 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.684155 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.684328 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.684468 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.684591 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.684711 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.684902 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.685031 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.685205 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.685331 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.685481 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.685607 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.685804 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.685933 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.686100 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.686239 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.686361 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.686482 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.686640 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.686768 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.686938 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.687066 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.687236 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.687371 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.687517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.687729 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.687856 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.687976 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.688097 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.688236 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.688388 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.688514 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.688699 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.688827 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689004 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689139 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689263 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689389 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689568 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689696 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689833 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.689963 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.690149 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.690275 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.690449 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.690575 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.690710 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.690844 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.691014 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.691142 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.691315 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.691441 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.691619 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.691761 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.691939 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.692066 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.692215 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.692342 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.692520 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.692652 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.692803 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.692942 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.693102 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.693251 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.693447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.693687 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.693817 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.693938 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694058 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694178 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694309 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694439 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694561 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694680 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694802 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.694923 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.695117 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.695253 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.695382 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.695503 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.695717 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.695858 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.695990 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.696112 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.696289 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.696427 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.696578 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.696705 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.696888 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.697028 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.697155 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.697282 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.697456 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.697591 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.697805 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.697997 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.698123 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.698244 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.698377 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.698507 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.698630 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.698750 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.698877 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699010 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699142 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699277 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699407 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699537 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699731 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699866 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.699988 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.700119 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.700304 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.700438 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.700590 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.700726 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.700878 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.701017 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.701559 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:50:53.701676 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.701882 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.702015 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.702222 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.702350 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.702581 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.702721 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.702881 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.703010 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.703217 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.703344 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.703546 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.703702 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.703825 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.703946 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.704141 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.704273 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.704451 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.704577 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.704738 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.704877 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.705044 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.705171 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.705358 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.705496 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.705656 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.705794 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.705954 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.706081 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.706273 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.706411 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.706581 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.706722 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.706876 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.707003 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.707186 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.707313 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.707489 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.707698 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.707831 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.707960 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.708163 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.708289 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.708411 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.708550 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.708673 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.708794 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.709009 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.709137 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.709343 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.709486 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.709639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.709767 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.709962 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.710097 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.710278 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.710407 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.710583 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.710719 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.710848 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.710970 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.711159 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.711289 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.711460 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.711610 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.711796 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.711926 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.712063 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.712186 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.712377 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.712502 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.712681 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.712806 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.712980 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.713104 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.713280 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.713417 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.713658 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.713792 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.713923 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.714052 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.714175 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.714295 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.714484 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.714616 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.714790 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.714914 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.715090 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.715216 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.715392 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.715524 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.715752 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.715873 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.715996 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.716129 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.716288 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.716422 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.716590 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.716722 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.716883 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.717006 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.717176 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.717309 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.717473 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.717605 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.717765 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.717889 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.718085 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.718287 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.718421 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.718552 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.718673 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.718793 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.718983 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.719115 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.719275 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.719405 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.719597 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.719726 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.719932 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.720057 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.720178 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.720299 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.720470 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.720593 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.720766 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.720890 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.721061 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.721192 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.721354 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.721487 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.721646 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.721770 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.721949 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.722071 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.722242 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.722375 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.722534 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.722657 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.722834 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.722960 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.723127 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.723265 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.723421 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.723546 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.723785 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.723918 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.724053 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.724188 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.724332 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.724457 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.724633 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.724756 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.724936 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.725062 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.725234 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.725359 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.725536 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.725667 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.725836 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.725961 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.726163 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.726288 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.726459 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.726582 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.726767 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.726891 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.727079 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.727203 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.727384 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.727508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.727702 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.727836 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.728005 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.728130 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.728331 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.728475 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.728598 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.728718 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.728874 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.729000 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.729166 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.729292 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.729454 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.729577 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.729744 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.729866 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.730033 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.730166 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.730325 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.730449 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.730615 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.730746 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.730907 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.731038 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.731207 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.731328 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.731498 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.731668 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.731803 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.731925 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.732095 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.732215 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.732390 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.732502 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.732735 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.732879 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.733002 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.733122 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.733321 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.733447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.733681 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.733793 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.733989 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.734097 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.734282 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.734392 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.734582 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.734703 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.734879 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.734997 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.735175 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.735293 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.735471 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.735604 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.735793 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.735913 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.736093 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.736214 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.736391 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.736501 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.736692 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.736804 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.736990 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.737179 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.737304 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.737586 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.737709 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.737893 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.738185 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.738316 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.738519 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.738751 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.738877 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.739107 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.739314 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.739435 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.739732 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.739858 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.740032 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.740334 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.740475 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.740633 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.740765 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.740931 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.741094 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.741219 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.741426 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.741563 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.741750 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.741876 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.742064 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.742195 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.742376 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.742507 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.742673 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.742816 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.742982 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.743106 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.743277 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.743401 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.743600 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.743884 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.744043 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.744246 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.744371 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.744493 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.744614 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.744793 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.744919 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.745092 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.745221 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.745392 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.745518 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.745700 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.745827 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.745997 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.746128 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.746296 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.746433 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.746602 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.746726 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.746898 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.747023 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.747197 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.747322 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.747499 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.747656 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.747830 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.748143 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.748364 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.748505 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.748706 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.748940 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.749090 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.749221 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.749346 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.749346 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.749719 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.750004 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.750157 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.750516 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.750640 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.750833 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.750957 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.751133 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.751259 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.751446 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.751595 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.751785 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.751910 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.752081 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.752207 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.752377 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.752502 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.752689 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.752824 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.752989 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.753113 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.753284 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.753408 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.753579 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.753712 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.753873 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.753997 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.754189 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.754404 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.754531 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.754667 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.754791 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.754912 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.755066 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.755199 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.755374 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.755508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.755692 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.755817 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.756003 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.756128 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.756297 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.756421 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.756585 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.756713 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.756880 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.757005 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.757178 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.757304 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.757474 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.757598 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.757775 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.757910 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.758074 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.758201 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.758372 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.758498 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.758759 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.758896 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759028 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759158 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759280 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759401 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759582 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759710 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759891 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.759979 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.760200 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.760285 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.760499 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.760595 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.760798 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.760893 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.761102 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.761369 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.761462 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.761692 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.761779 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.761994 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.762080 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.762301 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.762386 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.762601 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.762687 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.762904 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.762990 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.763206 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.763310 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.763500 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.763624 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.763827 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.763933 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.764139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.764235 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.764438 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.764753 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.764844 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.765073 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.765199 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.765374 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.765509 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.765669 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.765800 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.765964 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.766091 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.766259 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.766393 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.766559 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.766683 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.766858 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.766989 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.767159 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.767286 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.767452 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.767625 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.767771 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.767905 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.768072 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.768198 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.768365 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.768491 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.768665 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.768802 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.768990 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.769115 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.769252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.769376 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.769530 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.769655 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.769820 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.769953 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.770109 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.770235 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.770400 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.770524 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.770694 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.770827 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.770990 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.771115 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.771295 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.771420 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.771621 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.771773 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.771926 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.772034 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.772220 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.772309 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.772523 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.772696 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.772819 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.772905 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.773162 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.773252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.773404 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.773496 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.773695 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.773784 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.773995 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.774081 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.774294 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.774383 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.774585 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.774671 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.774884 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.774978 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.775180 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.775276 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.775475 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.775601 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.775849 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.775946 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.776157 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.776243 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.776451 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.776536 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.776745 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.776842 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777038 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777129 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777331 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777417 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777624 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777724 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777915 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.777998 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.778209 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.778283 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.778505 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.778597 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.778795 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.778897 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.779090 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.779176 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.779380 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.779472 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.779703 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.779803 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.779997 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.780091 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.780306 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.780393 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.780608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.780692 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.780902 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.780986 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.781195 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.781280 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.781483 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.781566 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.781780 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.781871 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.782072 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.782165 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.782361 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.782444 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.782651 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.782734 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.782943 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.783027 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.783234 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.783322 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.783526 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.783658 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.783842 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.783928 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.784140 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.784232 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.784438 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.784542 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.784729 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.784812 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785029 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785113 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785324 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785416 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785614 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785697 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785904 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.785994 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.786197 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.786290 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.786487 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.786571 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.786777 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.786868 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.787067 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.787151 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.787358 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.787449 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.787684 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.787773 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.787980 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.788066 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.788281 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.788364 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.788572 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.788663 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.788864 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.788956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.789155 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.789240 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.789458 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.789542 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.789755 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.789847 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.790051 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.790163 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.790345 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.790452 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.790639 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.790730 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.790930 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.791026 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.791246 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.791404 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.791587 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.791732 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.791956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.792100 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.792238 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.792393 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.792393 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.792676 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.792813 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.792948 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.793086 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.793237 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.793411 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.793561 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.793719 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.793912 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.794062 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.794200 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.794344 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.794491 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.794629 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.794847 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.795001 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.795139 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.795276 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.795430 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.795601 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.795745 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.795894 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.796087 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.796228 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.796373 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.796514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.796651 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.796795 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.796933 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.797069 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.797205 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.797354 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.797490 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.797641 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.797779 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.797915 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.798051 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.798187 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.798331 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.798469 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.798606 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.798748 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.798886 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.799023 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.799182 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.799321 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.799457 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.799639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.799793 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.799939 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.800158 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.800301 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.800437 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.800574 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.800718 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.800864 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.801020 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.801158 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.801294 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.801432 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.801567 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.801711 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.801850 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.802003 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.802216 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.802359 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.802515 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.802663 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.802803 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.802950 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.803087 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.803225 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.803361 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.803506 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.803666 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.803807 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.803944 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.804081 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.804229 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.804376 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.804513 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.804650 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.804805 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.804805 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.805166 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.805305 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.805442 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.805442 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.805701 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.805838 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.805984 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.806123 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.806259 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.806395 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.806531 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.806678 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.806828 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.806965 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.807102 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.807239 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.807375 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.807525 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.807709 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.807859 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.807996 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.808134 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.808279 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.808436 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.808575 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.808711 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.808847 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.808985 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.809129 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.809277 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.809423 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.809561 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.809698 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.809835 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.809972 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.810117 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.810266 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.810402 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.810539 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.810712 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.810866 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.811026 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.811169 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.811339 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.811490 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.811724 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.811837 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.812002 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.812134 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.812302 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.812434 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.812612 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.812758 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.812930 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.813063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.813193 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.813373 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.813626 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.813787 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.813874 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.813962 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.814079 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.814258 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.814404 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.814571 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.814717 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.814874 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.814967 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.815165 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.815371 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.815463 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.815710 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.815818 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.816012 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.816102 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.816323 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.816427 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.816645 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.816736 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.816929 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.817092 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.817238 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.817390 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.817545 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.817697 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.817840 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.817983 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.818136 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.818280 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.818432 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.818584 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.818729 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.818872 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.819015 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.819166 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.819319 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.819463 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.819626 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.819775 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.819921 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.820088 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.820233 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.820391 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.820536 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.820679 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.820827 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.820990 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.821135 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.821286 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.821432 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.821581 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.821733 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.821898 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.822054 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.822197 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.822422 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.822576 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.822736 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.822881 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.823023 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.823165 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.823308 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.823449 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.823663 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.823846 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.824003 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.824155 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.824299 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.824443 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.824600 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.824752 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.824898 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.825049 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.825275 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.825437 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.825591 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.825745 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.825890 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.826045 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.826548 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.826706 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.826857 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.827002 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.827145 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.827355 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.827501 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.827678 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.827838 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.827987 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.828130 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.828273 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.828428 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.828585 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.828736 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.828880 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.829024 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.829167 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.829319 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.829476 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.829621 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.829763 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.829905 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.830048 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.830216 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.830361 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.830503 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.830503 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.830777 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.830920 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.831071 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.831217 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.831361 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.831505 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.831677 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.831823 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.831979 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.832143 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.832296 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.832470 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.832686 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.832849 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.833221 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.833388 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.833534 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.833679 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.833848 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.833848 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.834140 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.834140 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.834427 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.834572 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.834715 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.835004 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.835173 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.835410 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.835609 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.835770 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.835918 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.836085 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.836239 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.836386 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.836542 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.836686 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.836829 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.836982 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.837127 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.837279 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.837424 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.837571 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.837727 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.837880 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.838031 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.838177 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.838320 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.838482 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.838703 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.838849 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.839000 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.839145 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.839393 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.839544 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.839741 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.839889 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.840040 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.840184 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.840337 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.840481 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.840645 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.840791 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.840934 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.841077 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.841220 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.841371 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.841523 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.841668 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.841812 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.841955 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.842099 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.842250 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.842402 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.842558 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.842718 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.842956 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.843107 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.843266 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.843266 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.843544 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.843736 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.843892 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.844039 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.844192 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.844339 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.844494 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.844645 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.844791 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.844944 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.845089 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.845239 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.845407 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.845620 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.845769 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.845923 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.846077 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.846223 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.846379 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.846524 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.846676 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.846831 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.846983 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.847134 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.847281 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.847425 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.847640 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.847803 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.847950 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.848096 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.848250 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.848394 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.848551 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.848697 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.848840 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.848993 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.849137 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.849290 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.849435 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.849582 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.849726 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.849876 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.850033 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.850187 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.850332 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.850485 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.850630 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.850774 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.850929 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.851074 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.851224 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.851224 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.851497 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.851668 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.851835 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.851989 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.852136 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.852288 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.852433 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.852576 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.852728 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.852874 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.853099 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.853257 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.853404 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.853547 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.853706 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.853878 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.854023 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.854169 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.854314 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.854466 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.854611 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.854763 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.854908 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.855051 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.855201 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.855201 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.855490 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.855766 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.855932 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.856081 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.856224 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.856414 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.856570 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.856716 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.856862 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.857005 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.857158 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.857158 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.857441 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.857586 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.857741 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.857885 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.858037 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.858190 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.858335 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.858533 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.858683 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.858827 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.858979 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.859132 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.859276 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.859420 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.859587 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.859769 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.859931 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.860077 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.860221 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.860366 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.860510 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.860661 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.860806 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.860806 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.861082 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.861237 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.861384 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.861553 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.861706 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.861858 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.862003 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.862146 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.862289 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.862445 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.862591 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.862734 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.862877 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.863020 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.863255 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.863416 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.863617 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.863770 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.863916 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.864060 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.864217 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.864364 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.864508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.864653 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.864796 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.864946 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.865103 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.865251 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.865396 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.865550 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.865712 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.865928 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.866088 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.866233 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.866391 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.866545 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.866690 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.866834 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.866834 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.867197 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.867342 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.867485 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.867485 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.867823 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.867983 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.868135 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.868280 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.868422 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.868565 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.868716 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.868861 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.869005 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.869150 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.869293 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.869447 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.869599 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.869743 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.869887 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870030 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870174 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870325 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870477 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870622 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870765 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870908 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.870908 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.871194 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.871363 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.871508 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.871676 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.871822 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.871966 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.872127 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.872272 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.872416 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.872568 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.872711 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.872854 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.873010 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.873156 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.873393 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.873544 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.873688 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.873840 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.873993 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.874166 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.874311 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.874462 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.874606 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.874758 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.874904 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.874904 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.875178 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.875333 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.875477 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.875683 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.875841 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.876067 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.876228 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.876374 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.876374 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.876657 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.876802 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.876954 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.877106 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.877270 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.877416 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.877569 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.877713 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.877857 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.877857 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.878138 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.878290 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.878435 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.878579 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.878729 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.878881 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.879036 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.879188 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.879334 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.879478 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.879645 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.879792 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.879937 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.880095 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.880240 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.880384 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.880535 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.880679 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.880831 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.880985 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.881129 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.881276 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.881422 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.881565 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.881722 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.881867 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.882011 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.882155 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.882298 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.882440 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.882593 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.882756 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.882902 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.883045 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.883187 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.883344 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.883594 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.883751 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.883906 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.884052 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.884197 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.884348 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.884500 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.884652 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.884808 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.884953 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.885097 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.885248 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.885401 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.885553 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.885698 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.885848 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.886004 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.886238 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.886390 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.886541 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.886699 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.886843 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.887000 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.887144 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.887289 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.887432 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.887630 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.887782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.887941 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.888086 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.888229 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.888372 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.888529 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.888681 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.888834 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.888986 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.889131 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.889131 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.889415 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.889566 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.889770 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.889921 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.890065 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.890209 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.890353 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.890525 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.890671 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.890815 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.890968 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.891113 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.891263 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.891418 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.891593 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.891743 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.891888 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.892032 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.892193 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.892339 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.892492 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.892636 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.892780 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.892931 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.893084 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.893229 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.893373 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.893516 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.893739 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.893890 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.894048 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.894195 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.894339 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.894497 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.894641 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.894784 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.895010 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.895159 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.895302 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.895445 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.895648 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.895813 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.895962 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.896107 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.896273 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.896273 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.896638 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.896792 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.896936 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.897093 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.897247 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.897391 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.897534 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.897689 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.897841 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.897985 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.898128 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.898272 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.898427 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.898580 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.898725 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.898869 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.899020 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.899171 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.899331 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.899477 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.899641 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.899788 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.899941 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.900092 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.900244 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.900399 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.900543 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.900687 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.900831 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.900974 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901274 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901418 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901561 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901704 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901704 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901991 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.901991 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.902281 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.902427 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.902571 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.902722 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.902867 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.903011 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.903154 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.903298 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.903442 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.903660 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.903890 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.904051 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.904195 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.904195 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.904477 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.904625 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.904775 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.904928 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.905072 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.905222 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.905401 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.905558 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.905711 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.905857 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.906018 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.906163 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.906314 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.906482 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.906694 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.906694 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.906993 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.907140 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.907292 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.907437 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.907614 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.907766 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.907922 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.908080 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.908232 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.908383 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.908527 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.908671 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.908859 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909025 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909177 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909321 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909465 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.909608 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.910690 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.910690 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.910690 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.910690 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.910690 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:50:53.910690 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:50:54.061409 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO dbcounter [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Registered counter for database nova_api Jul 26 04:50:54.065460 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Registered counter for database nova_api Jul 26 04:50:54.082142 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_db.sqlalchemy.engines [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.085168 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.089068 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writer thread running {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.091814 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.144567 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.context [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81272727-2a60-4ee7-8404-1f09619562b8(cell1) {{(pid=103254) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:50:54.147600 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.context [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81272727-2a60-4ee7-8404-1f09619562b8(cell1) {{(pid=103253) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:50:54.148515 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_concurrency.lockutils [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:54.150078 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_concurrency.lockutils [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:54.150853 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_concurrency.lockutils [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:54.151697 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:54.152844 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_concurrency.lockutils [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:54.153253 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:54.154043 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:50:54.154798 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO dbcounter [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Registered counter for database nova_cell0 Jul 26 04:50:54.156259 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:50:54.158272 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Registered counter for database nova_cell0 Jul 26 04:50:54.160513 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO dbcounter [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Registered counter for database nova_cell1 Jul 26 04:50:54.163890 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Registered counter for database nova_cell1 Jul 26 04:50:54.169185 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_db.sqlalchemy.engines [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.170202 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_db.sqlalchemy.engines [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.172624 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.174682 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writer thread running {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.177947 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.178719 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.309292 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writer thread running {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.316937 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.319405 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO dbcounter [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Registered counter for database nova_cell0 Jul 26 04:50:54.326861 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO dbcounter [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Registered counter for database nova_cell0 Jul 26 04:50:54.329546 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG oslo_db.sqlalchemy.engines [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.335112 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writer thread running {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.336865 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_db.sqlalchemy.engines [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:50:54.342040 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writer thread running {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:50:54.666516 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:50:54.668380 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: WARNING keystonemiddleware.auth_token [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:50:54.673831 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:50:54.675717 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: WARNING keystonemiddleware.auth_token [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:50:55.011223 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:50:55.017122 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: WARNING keystonemiddleware.auth_token [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:50:55.017668 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: WARNING keystonemiddleware.auth_token [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:50:55.022337 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb850e79c0 pid: 103253 (default app) Jul 26 04:50:55.023745 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: WARNING keystonemiddleware.auth_token [None req-71699fd0-0976-4566-894c-84b99c8e0fd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:50:55.024625 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:50:55.025864 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001888 Jul 26 04:50:55.026244 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue Jul 26 04:50:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:50:55.029621 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb850e79c0 pid: 103254 (default app) Jul 26 04:52:12.102975 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:12.104022 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 26 04:52:12.106613 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:12.116208 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writing DB stats nova_api:SELECT=3 {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:12.117340 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writing DB stats nova_cell1:SELECT=3 {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:12.118196 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writing DB stats nova_cell0:SELECT=3 {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:12.118996 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:13.019873 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-65b97e93-6eff-49a6-8df2-8f8f0ffbbb79 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:13.058471 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-65b97e93-6eff-49a6-8df2-8f8f0ffbbb79 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.947220 Jul 26 04:52:13.059419 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jul 26 04:52:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:15.290022 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:15.292417 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-dccfbb0e-3c5c-4eef-ac19-b224c7a8679c None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002753 Jul 26 04:52:15.293282 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:15.777808 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-8baf487b-3692-48c2-9d45-2cbeddc46f5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:15.798035 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:15.798035 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: warnings.warn(msg) Jul 26 04:52:15.831862 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-8baf487b-3692-48c2-9d45-2cbeddc46f5b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.530283 Jul 26 04:52:15.832633 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:52:16.045272 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-3db08c96-5f68-45cc-8526-948ebe2ffe71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:16.049770 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:16.049770 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 26 04:52:16.052682 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=3 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:16.053616 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell0:SELECT=3 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:16.054550 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell1:SELECT=3 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:16.055448 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:16.121265 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-3db08c96-5f68-45cc-8526-948ebe2ffe71 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280176 Jul 26 04:52:16.122273 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jul 26 04:52:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:18.367264 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-8baf487b-3692-48c2-9d45-2cbeddc46f5b admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:18.368237 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-8baf487b-3692-48c2-9d45-2cbeddc46f5b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 26 04:52:18.368635 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:19.079786 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-f91e1f0e-61c0-43c0-bee3-e9d622f34adb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:19.098618 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:19.098618 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 26 04:52:19.120565 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-f91e1f0e-61c0-43c0-bee3-e9d622f34adb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.745304 Jul 26 04:52:19.121388 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:52:19.133752 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-3c3653a8-f076-486e-b0b9-084851ce4db4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:19.136641 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:19.136641 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: warnings.warn(msg) Jul 26 04:52:19.174196 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-3c3653a8-f076-486e-b0b9-084851ce4db4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044135 Jul 26 04:52:19.175195 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jul 26 04:52:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:22.171757 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-f91e1f0e-61c0-43c0-bee3-e9d622f34adb admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:22.173495 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-f91e1f0e-61c0-43c0-bee3-e9d622f34adb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002305 Jul 26 04:52:22.174177 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:22.697917 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-96333ddb-6ed1-4728-bd4d-39364c98cab9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "id": "d2", "swap": 0, "vcpus": 1}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:22.721559 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-96333ddb-6ed1-4728-bd4d-39364c98cab9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.537021 Jul 26 04:52:22.722352 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:52:22.735469 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-50de72ba-c17d-4951-b572-43e9d3ed5b61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:22.768242 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-50de72ba-c17d-4951-b572-43e9d3ed5b61 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036336 Jul 26 04:52:22.769283 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jul 26 04:52:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:25.142839 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-96333ddb-6ed1-4728-bd4d-39364c98cab9 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:25.143807 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-96333ddb-6ed1-4728-bd4d-39364c98cab9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 26 04:52:25.144208 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:25.684126 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-212a431b-8123-4e45-af3a-c0339b51709a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:25.707631 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-212a431b-8123-4e45-af3a-c0339b51709a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.556784 Jul 26 04:52:25.708939 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:52:25.728489 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-e3cdf708-d6bb-4cc8-a8ab-678ba342c3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:25.758655 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-e3cdf708-d6bb-4cc8-a8ab-678ba342c3d4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036690 Jul 26 04:52:25.759646 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jul 26 04:52:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:28.315341 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-212a431b-8123-4e45-af3a-c0339b51709a admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:28.316492 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-212a431b-8123-4e45-af3a-c0339b51709a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 26 04:52:28.317214 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:29.268791 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-1f677f59-6f4d-46bb-a62a-ef19565a36f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "id": "d4", "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:29.306302 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-1f677f59-6f4d-46bb-a62a-ef19565a36f7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.977872 Jul 26 04:52:29.307874 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:52:29.329802 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-46b45624-1c05-4c75-b806-2b05a75fdc26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:29.377877 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-46b45624-1c05-4c75-b806-2b05a75fdc26 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055719 Jul 26 04:52:29.378989 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jul 26 04:52:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:32.411606 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-1f677f59-6f4d-46bb-a62a-ef19565a36f7 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:32.411606 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-1f677f59-6f4d-46bb-a62a-ef19565a36f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jul 26 04:52:32.412765 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:52:33.112519 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-29ccda29-09ae-4dd7-820a-87070061f161 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:33.140296 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-29ccda29-09ae-4dd7-820a-87070061f161 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.715568 Jul 26 04:52:33.140923 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jul 26 04:52:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:52:35.767676 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-1f677f59-6f4d-46bb-a62a-ef19565a36f7 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:35.769148 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-1f677f59-6f4d-46bb-a62a-ef19565a36f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Jul 26 04:52:35.769788 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:52:36.331102 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-325bb385-3424-4011-b762-2375cc835b4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "disk": 1, "ram": 512}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:36.368467 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-325bb385-3424-4011-b762-2375cc835b4c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.590308 Jul 26 04:52:36.369522 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:52:36.389986 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-bf2fe262-7dc7-4d55-af9f-3fe7df7fda22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:36.433474 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-bf2fe262-7dc7-4d55-af9f-3fe7df7fda22 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050061 Jul 26 04:52:36.434498 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jul 26 04:52:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:39.275270 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-325bb385-3424-4011-b762-2375cc835b4c admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:39.276975 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-325bb385-3424-4011-b762-2375cc835b4c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Jul 26 04:52:39.277533 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:52:39.840280 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-07131ab4-7a6c-4369-afef-5c91daa9a0f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:39.867609 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-07131ab4-7a6c-4369-afef-5c91daa9a0f2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.581518 Jul 26 04:52:39.868470 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:52:39.886778 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-2a32c535-c43c-46b1-abb8-b702fbc50540 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:39.919035 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-2a32c535-c43c-46b1-abb8-b702fbc50540 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036453 Jul 26 04:52:39.920151 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jul 26 04:52:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:42.499924 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-07131ab4-7a6c-4369-afef-5c91daa9a0f2 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:42.501672 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-07131ab4-7a6c-4369-afef-5c91daa9a0f2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 Jul 26 04:52:42.503908 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:42.998367 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-2e0c6afb-25f2-47b9-a138-058e014521de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "swap": 0, "id": "3"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:43.030728 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-2e0c6afb-25f2-47b9-a138-058e014521de admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.521005 Jul 26 04:52:43.032430 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:52:43.050045 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-23d4240c-28ad-4beb-8673-2599d47f9cc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:43.065211 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:43.112454 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-23d4240c-28ad-4beb-8673-2599d47f9cc2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070262 Jul 26 04:52:43.113914 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jul 26 04:52:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:52:45.867720 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-2e0c6afb-25f2-47b9-a138-058e014521de admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:45.869116 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-2e0c6afb-25f2-47b9-a138-058e014521de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Jul 26 04:52:45.869660 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:52:46.712103 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-795e35a4-757c-405c-abf2-40811b4c1ca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:46.741921 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-795e35a4-757c-405c-abf2-40811b4c1ca7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.865111 Jul 26 04:52:46.753275 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 04:52:46.759637 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-d046b198-7807-4e14-8a12-93e5c547abc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:46.770928 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:46.803797 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-d046b198-7807-4e14-8a12-93e5c547abc5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048717 Jul 26 04:52:46.804803 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jul 26 04:52:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:52:49.477098 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-795e35a4-757c-405c-abf2-40811b4c1ca7 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:52:49.479296 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-795e35a4-757c-405c-abf2-40811b4c1ca7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002893 Jul 26 04:52:49.483722 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:52:50.058364 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-a70e01bc-bfa9-4e3b-a001-669e1b80ae67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "disk": 160, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:50.096215 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-a70e01bc-bfa9-4e3b-a001-669e1b80ae67 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.608527 Jul 26 04:52:50.098453 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jul 26 04:52:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:52:50.115987 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-d5f4415b-fbbf-47a6-b7d2-b9faf0ebbfd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:52:50.152029 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-d5f4415b-fbbf-47a6-b7d2-b9faf0ebbfd7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040240 Jul 26 04:52:50.152752 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jul 26 04:52:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 04:53:10.042472 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-a70e01bc-bfa9-4e3b-a001-669e1b80ae67 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:10.043493 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-a70e01bc-bfa9-4e3b-a001-669e1b80ae67 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 26 04:53:10.043967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:10.059427 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:10.709369 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-d03fe94b-cfd7-49bb-b27c-94581dd82791 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:10.730849 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-d03fe94b-cfd7-49bb-b27c-94581dd82791 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.676172 Jul 26 04:53:10.731526 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jul 26 04:53:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 04:53:11.973613 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-a70e01bc-bfa9-4e3b-a001-669e1b80ae67 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:11.974631 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-a70e01bc-bfa9-4e3b-a001-669e1b80ae67 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 26 04:53:11.975043 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:12.623167 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-ab95d62f-05ba-4a39-9b3e-b1f8dac17da7 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:12.629990 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.wsgi [None req-ab95d62f-05ba-4a39-9b3e-b1f8dac17da7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-ab95d62f-05ba-4a39-9b3e-b1f8dac17da7 admin admin] Request method failure captured: Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Accept: application/json Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Accept-Encoding: gzip, deflate Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Connection: keep-alive Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Content-Length: 0 Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Host: 10.222.0.17 Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Openstack-Api-Version: compute 2.90 Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Openstack-System-Scope: None Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: User-Agent: python-novaclient Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Auth-Token: gAAAAABi33M3fIqqyUzjgBgnDNykdoHCkvnRkd-ITryr2OtmZ7DEPJH30HPPPXmFXZ8ANnPsrAhOHX2GsoMxs6cisR5lslvooKju5qQ3ACj7s0MGw-5U6-JUiWED_upBeVmJAqCsy_M5rvxXPb-9a9iss3_dwD_hZZIBFUgNDSR8hZ3kMyaDukY Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Domain-Id: None Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Domain-Name: None Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Identity-Status: Confirmed Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Is-Admin-Project: True Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Domain-Id: default Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Domain-Name: Default Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Name: admin Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Role: admin,reader,member Jul 26 04:53:12.633517 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Roles: admin,reader,member Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12823499382429e9825c57ea3292c56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12823499382429e9825c57ea3292c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}] Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant: admin Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant-Name: admin Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User: admin Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Domain-Id: default Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Domain-Name: Default Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Id: 1baa40dae37f4b3298a95bdc939c2f42 Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Name: admin Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: method: > Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: exception: Flavor 42 could not be found. Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: action_args: {'id': '42'} Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:12.635426 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:12.637447 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.640082 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-ab95d62f-05ba-4a39-9b3e-b1f8dac17da7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:12.642472 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-ab95d62f-05ba-4a39-9b3e-b1f8dac17da7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.517681 Jul 26 04:53:12.642472 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jul 26 04:53:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 519 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:12.649036 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-bd43e032-b45a-4ca7-8769-cf409ea94aef admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:12.653997 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:12.675248 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-bd43e032-b45a-4ca7-8769-cf409ea94aef admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029941 Jul 26 04:53:12.675961 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jul 26 04:53:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:12.686819 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-ed6841f5-cf14-47e5-b21f-b7e30a3a566f admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:12.713884 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-ed6841f5-cf14-47e5-b21f-b7e30a3a566f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030814 Jul 26 04:53:12.714472 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jul 26 04:53:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:12.726025 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-fa58cc00-e1ae-4825-95ad-ef6e306c8170 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:12.733098 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.wsgi [None req-fa58cc00-e1ae-4825-95ad-ef6e306c8170 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-fa58cc00-e1ae-4825-95ad-ef6e306c8170 admin admin] Request method failure captured: Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Accept: application/json Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Accept-Encoding: gzip, deflate Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Connection: keep-alive Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Content-Length: 0 Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Host: 10.222.0.17 Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Openstack-Api-Version: compute 2.90 Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Openstack-System-Scope: None Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: User-Agent: python-novaclient Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Auth-Token: gAAAAABi33M3fIqqyUzjgBgnDNykdoHCkvnRkd-ITryr2OtmZ7DEPJH30HPPPXmFXZ8ANnPsrAhOHX2GsoMxs6cisR5lslvooKju5qQ3ACj7s0MGw-5U6-JUiWED_upBeVmJAqCsy_M5rvxXPb-9a9iss3_dwD_hZZIBFUgNDSR8hZ3kMyaDukY Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Domain-Id: None Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Domain-Name: None Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Identity-Status: Confirmed Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Is-Admin-Project: True Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Domain-Id: default Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Domain-Name: Default Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Name: admin Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Role: admin,reader,member Jul 26 04:53:12.736508 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Roles: admin,reader,member Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12823499382429e9825c57ea3292c56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12823499382429e9825c57ea3292c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}] Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant: admin Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant-Name: admin Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User: admin Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Domain-Id: default Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Domain-Name: Default Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Id: 1baa40dae37f4b3298a95bdc939c2f42 Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Name: admin Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: method: > Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: exception: Flavor 42 could not be found. Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: action_args: {'id': '42'} Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:12.739145 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:12.741063 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:12.743369 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-fa58cc00-e1ae-4825-95ad-ef6e306c8170 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:12.745807 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-fa58cc00-e1ae-4825-95ad-ef6e306c8170 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017152 Jul 26 04:53:12.745807 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jul 26 04:53:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:13.832925 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-ed6841f5-cf14-47e5-b21f-b7e30a3a566f admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:13.834215 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-ed6841f5-cf14-47e5-b21f-b7e30a3a566f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Jul 26 04:53:13.834722 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:53:14.526403 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-728dcc60-4629-4d31-aca6-98b9ed18e336 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:14.533431 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.wsgi [None req-728dcc60-4629-4d31-aca6-98b9ed18e336 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-728dcc60-4629-4d31-aca6-98b9ed18e336 admin admin] Request method failure captured: Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Accept: application/json Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Accept-Encoding: gzip, deflate Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Connection: keep-alive Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Content-Length: 0 Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Host: 10.222.0.17 Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Openstack-Api-Version: compute 2.90 Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Openstack-System-Scope: None Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: User-Agent: python-novaclient Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Auth-Token: gAAAAABi33M5-Cfe2dycLqaev9zIh4uwAvlqBVgiBlzwHb7DC7yeWQ8lWsMn_hZfuMxlChuwDd8I2ATlMhy7C6b1cJg0_Zv5vM3nl5icW-seUjugJEPINBak2gggpLJ_13Qedneb89kLiun7-yB7myYiAT39IIE01p6RkRIJRtnaesiACpmKNbE Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Domain-Id: None Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Domain-Name: None Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Identity-Status: Confirmed Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Is-Admin-Project: True Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Domain-Id: default Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Domain-Name: Default Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Name: admin Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Role: admin,reader,member Jul 26 04:53:14.535014 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Roles: admin,reader,member Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12823499382429e9825c57ea3292c56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12823499382429e9825c57ea3292c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}] Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant: admin Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant-Name: admin Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User: admin Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Domain-Id: default Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Domain-Name: Default Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Id: 1baa40dae37f4b3298a95bdc939c2f42 Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Name: admin Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: method: > Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: exception: Flavor 84 could not be found. Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: action_args: {'id': '84'} Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:14.537956 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:14.539811 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.542136 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-728dcc60-4629-4d31-aca6-98b9ed18e336 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:14.544623 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-728dcc60-4629-4d31-aca6-98b9ed18e336 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.556361 Jul 26 04:53:14.544623 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jul 26 04:53:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 558 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:14.548404 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-cb2bcfad-3e4d-451b-af27-e2fb6bcd6d46 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:14.566236 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-cb2bcfad-3e4d-451b-af27-e2fb6bcd6d46 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022483 Jul 26 04:53:14.566939 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jul 26 04:53:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:14.577708 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-a0e412bc-529e-4680-98de-71bc3602d49f admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:14.596569 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-a0e412bc-529e-4680-98de-71bc3602d49f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022614 Jul 26 04:53:14.597071 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jul 26 04:53:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:14.608068 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-192c3a1f-698a-4965-8747-d561886d1a4d admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:14.614381 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.wsgi [None req-192c3a1f-698a-4965-8747-d561886d1a4d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-192c3a1f-698a-4965-8747-d561886d1a4d admin admin] Request method failure captured: Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Accept: application/json Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Accept-Encoding: gzip, deflate Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Connection: keep-alive Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Content-Length: 0 Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Host: 10.222.0.17 Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Openstack-Api-Version: compute 2.90 Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Openstack-System-Scope: None Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: User-Agent: python-novaclient Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Auth-Token: gAAAAABi33M5-Cfe2dycLqaev9zIh4uwAvlqBVgiBlzwHb7DC7yeWQ8lWsMn_hZfuMxlChuwDd8I2ATlMhy7C6b1cJg0_Zv5vM3nl5icW-seUjugJEPINBak2gggpLJ_13Qedneb89kLiun7-yB7myYiAT39IIE01p6RkRIJRtnaesiACpmKNbE Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Domain-Id: None Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Domain-Name: None Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Identity-Status: Confirmed Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Is-Admin-Project: True Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Domain-Id: default Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Domain-Name: Default Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Name: admin Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Role: admin,reader,member Jul 26 04:53:14.616126 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Roles: admin,reader,member Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12823499382429e9825c57ea3292c56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12823499382429e9825c57ea3292c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}] Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant: admin Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant-Name: admin Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User: admin Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Domain-Id: default Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Domain-Name: Default Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Id: 1baa40dae37f4b3298a95bdc939c2f42 Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Name: admin Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: method: > Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: exception: Flavor 84 could not be found. Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: action_args: {'id': '84'} Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:14.618714 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:14.620139 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:14.622616 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-192c3a1f-698a-4965-8747-d561886d1a4d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:14.624747 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-192c3a1f-698a-4965-8747-d561886d1a4d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014013 Jul 26 04:53:14.624747 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jul 26 04:53:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:15.735597 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-a0e412bc-529e-4680-98de-71bc3602d49f admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:15.736817 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-a0e412bc-529e-4680-98de-71bc3602d49f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 26 04:53:15.737345 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:16.390796 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-a888204b-f384-49d8-9e80-64fa092a525e admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:16.397553 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.wsgi [None req-a888204b-f384-49d8-9e80-64fa092a525e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-a888204b-f384-49d8-9e80-64fa092a525e admin admin] Request method failure captured: Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Accept: application/json Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Accept-Encoding: gzip, deflate Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Connection: keep-alive Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Content-Length: 0 Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Host: 10.222.0.17 Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Openstack-Api-Version: compute 2.90 Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Openstack-System-Scope: None Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: User-Agent: python-novaclient Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Auth-Token: gAAAAABi33M7genL4X8yi3-FSwEjk-ZNUmNiMbdg-ki7bnsHMfllZ9nl9P2jLgHVXNN5h4-A56_ICzuiKlsMA3MSrKuX3MvqHFTCKsRhmh-zJG5HCDfykAMwDONt4DAMZljA01LsM9qTfZ1c8ychIO5qYHbEzVYWj_US84nT-XMd3iX2E9WuRTg Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Domain-Id: None Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Domain-Name: None Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Identity-Status: Confirmed Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Is-Admin-Project: True Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Domain-Id: default Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Domain-Name: Default Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Project-Name: admin Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Role: admin,reader,member Jul 26 04:53:16.399252 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Roles: admin,reader,member Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12823499382429e9825c57ea3292c56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12823499382429e9825c57ea3292c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}] Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant: admin Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-Tenant-Name: admin Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User: admin Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Domain-Id: default Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Domain-Name: Default Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Id: 1baa40dae37f4b3298a95bdc939c2f42 Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: X-User-Name: admin Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: method: > Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: exception: Flavor 451 could not be found. Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: action_args: {'id': '451'} Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:16.401514 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:16.403183 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.405639 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-a888204b-f384-49d8-9e80-64fa092a525e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:16.407764 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-a888204b-f384-49d8-9e80-64fa092a525e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.523313 Jul 26 04:53:16.407764 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jul 26 04:53:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 525 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 04:53:16.418362 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-459af5aa-c2d6-4861-9888-411cab3a1ead admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:16.448035 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-459af5aa-c2d6-4861-9888-411cab3a1ead admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.036582 Jul 26 04:53:16.449040 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jul 26 04:53:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:16.462884 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:16.480047 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020633 Jul 26 04:53:16.480743 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jul 26 04:53:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:53:16.491982 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-7fb56de7-108a-4f55-aa8a-7362760a3776 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:16.498081 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.wsgi [None req-7fb56de7-108a-4f55-aa8a-7362760a3776 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-7fb56de7-108a-4f55-aa8a-7362760a3776 admin admin] Request method failure captured: Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Accept: application/json Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Accept-Encoding: gzip, deflate Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Connection: keep-alive Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Content-Length: 0 Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Host: 10.222.0.17 Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Openstack-Api-Version: compute 2.90 Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Openstack-System-Scope: None Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: User-Agent: python-novaclient Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Auth-Token: gAAAAABi33M7genL4X8yi3-FSwEjk-ZNUmNiMbdg-ki7bnsHMfllZ9nl9P2jLgHVXNN5h4-A56_ICzuiKlsMA3MSrKuX3MvqHFTCKsRhmh-zJG5HCDfykAMwDONt4DAMZljA01LsM9qTfZ1c8ychIO5qYHbEzVYWj_US84nT-XMd3iX2E9WuRTg Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Domain-Id: None Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Domain-Name: None Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Identity-Status: Confirmed Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Is-Admin-Project: True Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Domain-Id: default Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Domain-Name: Default Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Project-Name: admin Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Role: admin,reader,member Jul 26 04:53:16.499615 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Roles: admin,reader,member Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d12823499382429e9825c57ea3292c56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d12823499382429e9825c57ea3292c56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d12823499382429e9825c57ea3292c56"}]}] Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant: admin Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant-Id: d12823499382429e9825c57ea3292c56 Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-Tenant-Name: admin Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User: admin Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Domain-Id: default Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Domain-Name: Default Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Id: 1baa40dae37f4b3298a95bdc939c2f42 Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: X-User-Name: admin Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: method: > Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: exception: Flavor 451 could not be found. Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: action_args: {'id': '451'} Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:53:16.501967 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:16.503346 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: ERROR nova.api.openstack.wsgi Jul 26 04:53:16.504782 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-7fb56de7-108a-4f55-aa8a-7362760a3776 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:53:16.506171 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-7fb56de7-108a-4f55-aa8a-7362760a3776 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013494 Jul 26 04:53:16.506171 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jul 26 04:53:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:17.579368 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:17.580499 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jul 26 04:53:17.581259 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:18.199451 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-002d2171-e121-4fa8-99b8-852095779678 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:18.222706 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-002d2171-e121-4fa8-99b8-852095779678 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.498376 Jul 26 04:53:18.223333 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jul 26 04:53:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:19.432597 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:19.433633 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 26 04:53:19.434033 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:20.090691 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-4cd35f96-2b68-4c98-9268-a24fbc023ab0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:20.114309 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-4cd35f96-2b68-4c98-9268-a24fbc023ab0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.538682 Jul 26 04:53:20.114892 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jul 26 04:53:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:21.155529 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:21.156636 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Jul 26 04:53:21.157041 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:21.813148 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-16ab11d0-11b1-41da-ad6b-462ff12d55ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:21.836431 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-16ab11d0-11b1-41da-ad6b-462ff12d55ee admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.541514 Jul 26 04:53:21.837106 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jul 26 04:53:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:22.983617 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:22.984697 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 26 04:53:22.985088 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:23.595322 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-26a45557-b093-4351-9f3e-5c73af1f5e6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:53:23.621598 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-26a45557-b093-4351-9f3e-5c73af1f5e6e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.491557 Jul 26 04:53:23.622613 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jul 26 04:53:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:53:24.685590 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:24.686872 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jul 26 04:53:24.687293 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:53:25.297262 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-02c8e6ed-74ba-4d8e-aaac-a36b39072994 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:53:25.319629 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-02c8e6ed-74ba-4d8e-aaac-a36b39072994 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.492349 Jul 26 04:53:25.320220 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue Jul 26 04:53:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:19.941093 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:19.942137 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-7f987925-7253-4805-b079-33a931b11ff4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 26 04:54:19.942529 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jul 26 04:54:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:54:19.953658 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:20.393743 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-8b2b112b-21fc-4fbc-b776-5eb1271994d3 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:20.415580 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-8b2b112b-21fc-4fbc-b776-5eb1271994d3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.466414 Jul 26 04:54:20.416184 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jul 26 04:54:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:54:20.438292 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG dbcounter [-] [103254] Writing DB stats nova_api:SELECT=14 {{(pid=103254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:20.444481 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-b4a3b93e-93be-4b6e-aa8b-54b7a213ed23 admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:20.456991 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-b4a3b93e-93be-4b6e-aa8b-54b7a213ed23 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020089 Jul 26 04:54:20.458323 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Tue Jul 26 04:54:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:20.477960 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-556c6eb2-29fb-4757-839e-7fcf4d814b1d admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:20.488673 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-556c6eb2-29fb-4757-839e-7fcf4d814b1d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017836 Jul 26 04:54:20.489343 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Tue Jul 26 04:54:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:20.501739 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:20.510175 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012526 Jul 26 04:54:20.510757 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Tue Jul 26 04:54:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:54:20.523333 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-09971939-c061-4bb1-aa06-11497ea67b62 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:54:20.531481 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-09971939-c061-4bb1-aa06-11497ea67b62 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012090 Jul 26 04:54:20.532075 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Tue Jul 26 04:54:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 04:57:52.372775 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:52.373965 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002248 Jul 26 04:57:52.374437 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:52.514694 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=6 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:52.717353 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-98b70dda-8533-4aeb-9cbd-dde4d11e2edd admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:52.719783 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:57:52.719783 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 26 04:57:52.721053 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-98b70dda-8533-4aeb-9cbd-dde4d11e2edd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:52.721497 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-98b70dda-8533-4aeb-9cbd-dde4d11e2edd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:52.722296 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-98b70dda-8533-4aeb-9cbd-dde4d11e2edd admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:52.722721 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-98b70dda-8533-4aeb-9cbd-dde4d11e2edd admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:52.758908 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-98b70dda-8533-4aeb-9cbd-dde4d11e2edd admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.245576 Jul 26 04:57:52.759488 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jul 26 04:57:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:57:53.617584 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:53.618641 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 26 04:57:53.619036 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:57:53.821375 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-514105aa-8b53-4214-8518-b519b65023b5 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:57:53.824020 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:57:53.824020 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 26 04:57:53.825546 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-514105aa-8b53-4214-8518-b519b65023b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:53.826011 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-514105aa-8b53-4214-8518-b519b65023b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:53.826841 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-514105aa-8b53-4214-8518-b519b65023b5 admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:57:53.827263 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-514105aa-8b53-4214-8518-b519b65023b5 admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:57:53.849163 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-514105aa-8b53-4214-8518-b519b65023b5 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.088008 Jul 26 04:57:53.849749 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jul 26 04:57:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 04:58:05.156477 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:05.157516 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 26 04:58:05.157933 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:58:05.318760 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell0:SELECT=4 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:05.320199 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_cell1:SELECT=4 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:05.321617 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG dbcounter [-] [103253] Writing DB stats nova_api:SELECT=8 {{(pid=103253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:05.376640 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-c2e44f04-d2ab-47ad-b8a0-16735cbf223e admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:05.379102 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:58:05.379102 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 26 04:58:05.380353 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-c2e44f04-d2ab-47ad-b8a0-16735cbf223e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:05.380787 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-c2e44f04-d2ab-47ad-b8a0-16735cbf223e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:05.381588 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-c2e44f04-d2ab-47ad-b8a0-16735cbf223e admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:05.382011 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-c2e44f04-d2ab-47ad-b8a0-16735cbf223e admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:05.407309 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-c2e44f04-d2ab-47ad-b8a0-16735cbf223e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.097119 Jul 26 04:58:05.407931 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jul 26 04:58:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:58:06.241859 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: DEBUG nova.api.openstack.wsgi [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] Calling method '>' {{(pid=103254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:06.242873 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: INFO nova.api.openstack.requestlog [None req-bf20a2c1-fe84-4b50-a64b-7239383978cb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 26 04:58:06.243254 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: [pid: 103254|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jul 26 04:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:58:06.445273 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG nova.api.openstack.wsgi [None req-00fd2e9a-098f-43d1-b277-474a6150dbe0 admin admin] Calling method '>' {{(pid=103253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:58:06.447629 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:58:06.447629 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: warnings.warn(msg) Jul 26 04:58:06.448843 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-00fd2e9a-098f-43d1-b277-474a6150dbe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:06.449279 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-00fd2e9a-098f-43d1-b277-474a6150dbe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:06.450054 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-00fd2e9a-098f-43d1-b277-474a6150dbe0 admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:58:06.450470 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: DEBUG oslo_concurrency.lockutils [None req-00fd2e9a-098f-43d1-b277-474a6150dbe0 admin admin] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:58:06.473286 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: INFO nova.api.openstack.requestlog [None req-00fd2e9a-098f-43d1-b277-474a6150dbe0 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087597 Jul 26 04:58:06.473860 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: [pid: 103253|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jul 26 04:58:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 04:59:01.914591 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: Tue Jul 26 04:59:01 2022 - graceful shutdown triggered... Jul 26 04:59:01.913256 dv-cinder-850574-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 04:59:01.915748 dv-cinder-850574-1-iscsi devstack@n-api.service[103253]: Gracefully killing worker 1 (pid: 103253)... Jul 26 04:59:01.916206 dv-cinder-850574-1-iscsi devstack@n-api.service[103254]: Gracefully killing worker 2 (pid: 103254)... Jul 26 04:59:02.914258 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: worker 1 buried after 1 seconds Jul 26 04:59:02.914258 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: worker 2 buried after 1 seconds Jul 26 04:59:02.914258 dv-cinder-850574-1-iscsi devstack@n-api.service[103252]: goodbye to uWSGI. Jul 26 04:59:02.916162 dv-cinder-850574-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 04:59:02.916811 dv-cinder-850574-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 04:59:02.920173 dv-cinder-850574-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 04:59:02.935218 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 04:59:02 2022] *** Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: nodename: dv-cinder-850574-1-iscsi Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: machine: x86_64 Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: clock source: unix Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: pcre jit disabled Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: detected number of CPU cores: 4 Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: current working directory: / Jul 26 04:59:02.938525 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: detected binary path: /usr/bin/uwsgi-core Jul 26 04:59:02.940082 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: your processes number limit is 47680 Jul 26 04:59:02.940082 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: your memory page size is 4096 bytes Jul 26 04:59:02.940082 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: detected max file descriptor number: 2048 Jul 26 04:59:02.940082 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: lock engine: pthread robust mutexes Jul 26 04:59:02.940082 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: thunder lock: enabled Jul 26 04:59:02.940082 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 04:59:02.940082 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 04:59:02.981856 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: Python main interpreter initialized at 0x55d714ab59c0 Jul 26 04:59:02.981856 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: python threads support enabled Jul 26 04:59:02.981856 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: your server socket listen backlog is limited to 100 connections Jul 26 04:59:02.981856 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: your mercy for graceful operations on workers is 90 seconds Jul 26 04:59:02.982509 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 04:59:02.982509 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: *** Operational MODE: preforking *** Jul 26 04:59:02.982740 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: *** uWSGI is running in multiple interpreter mode *** Jul 26 04:59:02.982740 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: spawned uWSGI master process (pid: 117980) Jul 26 04:59:02.982882 dv-cinder-850574-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 04:59:02.983459 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: spawned uWSGI worker 1 (pid: 117993, cores: 1) Jul 26 04:59:02.985161 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: spawned uWSGI worker 2 (pid: 117994, cores: 1) Jul 26 04:59:02.985161 dv-cinder-850574-1-iscsi devstack@n-api.service[117980]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 04:59:03.697022 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:59:03.770185 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 04:59:04.871837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:59:04.871837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: from cryptography.utils import int_from_bytes Jul 26 04:59:04.872566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:59:04.872566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: from cryptography.utils import int_from_bytes Jul 26 04:59:04.938705 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:59:04.938705 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: from cryptography.utils import int_from_bytes Jul 26 04:59:04.939929 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:59:04.939929 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: from cryptography.utils import int_from_bytes Jul 26 04:59:07.384109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:59:07.384682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:59:07.384952 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:59:07.385274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:59:07.385520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:59:07.385913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.386235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.386554 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.386868 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.387192 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.387500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.387850 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.388166 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.388490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.388747 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.389058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.389365 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850574-1-iscsi {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.389686 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.390171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.390483 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.390803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.391107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.391446 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.391762 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.392230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.393986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.393986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.393986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.393986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.393986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.394559 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.394559 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.394783 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.395099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.395403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.395842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850574-1-iscsi {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.396160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.396469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.396782 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.397207 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.397539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.397898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.398223 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.398558 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.398865 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.399191 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.399507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.399863 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.400182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.400480 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.400787 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.401088 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.401405 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.401712 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.402014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.402260 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.402578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.402886 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.403202 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.403524 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.403803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.404061 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.404374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.404691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.405036 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.405299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.406622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.406622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.406622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.406622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.407185 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.407185 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.407366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.407684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.408010 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.408311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.408628 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.409031 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.409284 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.409584 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.409926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.410241 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.410551 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.410862 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.411181 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.411495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.411860 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.412117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.412426 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.412754 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.413249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.413734 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.414157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.414333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.414646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.414948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.415279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.415591 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.415891 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.416194 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.416497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.416802 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.417105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.417408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.417709 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.418013 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.418314 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.418615 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.418933 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.419252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.419647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.419883 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.420188 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.420491 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.420806 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.421113 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.421419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.421737 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.422041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.422343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.422652 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.422960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.423266 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.423602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.423904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.424207 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.424539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.424828 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.425131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.425429 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.425730 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.426031 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.426329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.426630 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.426928 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.427223 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.427538 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.427883 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.428189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.428491 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.428792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.429159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.429488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.429818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.430176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.430468 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.430806 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.431146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.431443 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.431771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.432084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.432406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.432715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.433031 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.433349 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.433668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.433985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.434315 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.434628 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.434949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.435264 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.435630 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.435913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.436242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.436563 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.436872 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.437206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.437550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.437856 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.438182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.438505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.438818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.439129 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.439445 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.439794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.440125 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.440454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.440753 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.441061 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.441379 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.441667 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.441971 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.442486 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.442823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.443258 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.443518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.443803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.444159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.444432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.444930 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.445213 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.445457 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.445854 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.446091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.446339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.446728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.446939 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.447258 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.447615 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.447917 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.448222 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.448532 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.448840 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.449155 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.449458 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.449769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.450077 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.450380 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.450702 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.451008 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.451446 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.451668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.451967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.452273 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.452589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.452899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.453208 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.453527 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.453836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.454161 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.454472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.455135 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.455469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.455848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.456166 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.456467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.456794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.457104 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.457406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.457714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.458016 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.458315 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.458629 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.458910 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.459215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.459620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.459851 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.460206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.460486 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.460809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.461117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.461424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.461746 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.462194 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.462442 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.462644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.462985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.463324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.463668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.464175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.464496 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.464817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.465125 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.465534 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.465734 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.466046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.466365 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.466682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.466996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.467305 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.467787 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.467964 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.468287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.468590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.468903 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.469249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.469583 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.469899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.470216 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.470522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.470835 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.471142 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.471450 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.471944 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.472171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.472498 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.472806 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.473125 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.473440 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.473790 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.474073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.474389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.474690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.475002 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.475336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.475690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.476127 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.476573 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.476736 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.477078 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.477359 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.477669 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.477972 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.478274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.478580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.478894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.479200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.479504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.479838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.480149 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.480452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.480757 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.481058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.481366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.481688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.482118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.482300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.482624 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.482916 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.483221 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.483545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.483858 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.484169 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.484465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.484769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.485110 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.485419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.485718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.486032 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.486350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.486778 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.486972 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.487282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.487607 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.487931 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.488243 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.488554 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.488859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.489167 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.489478 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.490997 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.490997 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.490997 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.490997 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.491608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.491764 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.491948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.492309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.492866 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.493200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.493516 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.495226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.495226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.495226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.495226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.495226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.496091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.496091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.496091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.496519 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.496678 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.497025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.497203 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.497506 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.497811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.498112 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.498413 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.498714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.499012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.499312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.499766 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.500069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.500374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.500677 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.501004 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.501309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.501611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.501948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.502213 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.502551 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.502859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.503201 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.503533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.503899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.504200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.504509 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.504829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.505133 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.505432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.507679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.507679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.507679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.507679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.507679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.507679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.507679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.508960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.508960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.508960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.508960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.509588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.509588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.510073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.510073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.510390 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.510537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.510844 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.511153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.511452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.511796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.512103 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.512405 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.512819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.513005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.513335 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.513617 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.513943 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.514252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.514584 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.514846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.515156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.515458 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.515786 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.516093 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.516411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.516725 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.517019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.517333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.517633 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.517935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.518235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.518533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.518831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.519135 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.519439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.519762 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.520055 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.520376 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.520683 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.520983 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.521285 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.521581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.521930 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.522231 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.522589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.523022 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.523245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.523792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.523980 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.524175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.524489 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.524859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.525096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.525408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.526816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.526816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.526816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.526816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.527308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.527308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.527653 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.527947 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.528154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.528455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.528762 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.529073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.529378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.529750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.529988 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.530297 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.530607 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.530915 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.531222 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.531528 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.532207 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.532786 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.533555 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.533908 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.534294 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.534699 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.535035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.535398 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.535977 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.536459 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.537117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.537854 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.538293 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.538800 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.539255 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.539745 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.540210 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.540728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.541420 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.541990 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.542562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.543318 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.544030 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.544485 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.544891 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.545327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.545757 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.546209 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.546630 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.547053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.547472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.547941 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.548380 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.548817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.549370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.549927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.550239 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.550789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.551226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.551729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.552171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.552608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.553044 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.553587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.554082 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.554745 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.554976 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.555419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.555873 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.556303 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.556722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.557163 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.557662 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.558096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.558532 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.559088 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.559526 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.560131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.560567 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.560911 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.561333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.561752 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.562180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.562603 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.563025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.563838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.564050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.564472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.565006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.565301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.565737 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.566158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.566604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.567020 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.567457 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.567920 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.568422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.568855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.569274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.569787 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.570333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.571367 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.571797 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.572244 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.573388 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.574050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.574417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.574874 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.575514 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.575766 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.576227 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.576672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.577105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.577537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.577978 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.578505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.578953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.579333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.580135 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.580555 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.581047 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.581564 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.581956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.582386 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.582779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.584308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.584308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.584308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.584308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.585285 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.585285 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.586066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.586066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.586755 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.586958 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.587339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.587777 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.588198 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.588597 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.589160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.589378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.589791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.590190 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.590713 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.590986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.591706 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.592110 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.592504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.592904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.593305 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.593704 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.594532 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.594953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.595351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.596084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.596084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.596701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.596914 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.597311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.597705 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.598148 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.598550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.599021 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.599611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.600042 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.601290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.601290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.601290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.602174 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.602174 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.602581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.602948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.603340 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.603770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.604179 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.606071 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.606533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.606900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.607149 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.607529 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.607951 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.608348 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.608747 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.609152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.609712 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.610018 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.610430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.610831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.611250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.611644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.612311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.612709 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.613130 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.613538 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.613948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.614348 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.614906 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.615146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.615537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.615945 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.616332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.616802 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.617166 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.617524 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.617918 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.618312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.618724 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.619115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.619923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.620268 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.620668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.621092 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.621605 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.622113 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.622941 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.623370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.623791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.624181 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.624580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.625164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.625383 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.625715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.626105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.626513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.626975 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.627352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.627770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.628251 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.628643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.629033 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.629428 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.629828 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.630248 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.630587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.630977 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.631366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.631819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.632235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.632725 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.633011 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.633405 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.633787 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.634218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.634606 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.635017 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.635672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.636354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.636594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.637090 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.637729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.638277 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.638685 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.639127 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.639631 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.640361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.640729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.641138 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.641563 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.641998 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.642407 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.642744 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.643206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.643518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.643931 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.644324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.644716 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.645112 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.645707 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.645932 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.646260 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.646647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.647077 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.647411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.648063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.648312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.648593 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.648996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.649431 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.649836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.650234 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.650658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.651013 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.651403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.651814 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.652225 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.652593 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.652996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.653414 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.653798 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.654185 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.654699 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.655096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.655497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.656070 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.656282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.656754 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.657085 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.657541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.657960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.658340 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.658750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.659171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.659608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.660023 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.660403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.660794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.661169 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.661563 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.661962 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.662412 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.662727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.663111 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.663597 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.663961 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.664352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.664733 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.665115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.665505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.666153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.666308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.666618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.666999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.667378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.667784 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.668172 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.668553 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.668933 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.669323 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.669539 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:59:07.670299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.670517 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:59:07.670725 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.670725 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.671420 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:59:07.671685 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.671685 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.672095 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:59:07.672319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.672699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:59:07.672921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.673138 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.673345 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.673345 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.673841 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.674007 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.674149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.674337 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.674530 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.674730 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.674910 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.675053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.675186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.675345 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.675714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.675868 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.676306 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.676520 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.676733 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.676946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.677230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.677386 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.677585 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.677850 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.678005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.678404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850574-1-iscsi {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.679587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.679587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.679587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.679934 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.680027 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.680195 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.680303 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.680628 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.680829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.681062 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.681413 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.681515 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.681866 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.681965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.682284 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.682538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.682709 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.683106 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.683222 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.683544 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.683943 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.684116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.684375 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.684684 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.684776 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.685147 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.685245 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.685616 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.685780 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.686046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.686400 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.686513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.686857 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.686956 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.687276 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.687519 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.687735 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.688115 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.688219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.688571 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.688676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.689074 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.689259 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.689643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.689830 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.690157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.690573 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850574-1-iscsi {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.690672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.691060 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.691148 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.691536 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.691691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.691991 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:59:07.692239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.693053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.693605 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.694164 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.695782 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.695782 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.696094 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.696505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.696887 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.697470 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.698050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.698630 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.699224 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.699935 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.700546 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.701133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.701691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.702151 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.702716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.703286 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.703926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.704320 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.705050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.705432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.705941 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.706533 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.707072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.707687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.708261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.708820 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.709408 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.709995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.710630 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.711212 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.711824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.712430 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.713029 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.713588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.714167 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.714863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.715337 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.715931 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.716554 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.716929 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.717472 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.718057 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.718634 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.719203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.719769 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.720327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.720900 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.721494 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.722083 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.722498 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.723060 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.723677 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.724270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.724831 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.725387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.726057 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.726639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.727206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.727829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.728428 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.728962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.729535 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.730103 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.730672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.731230 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.731789 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.732386 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.732976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.733549 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.734063 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.734513 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.735123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.736527 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.736527 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.736879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.737348 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.737976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.738457 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.739059 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.739685 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.740252 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.740825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.741381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.741974 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.742558 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.743127 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.743719 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.744288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.744813 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.745374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.745898 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.746398 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.746933 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.747512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.748149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.748742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.749314 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.749866 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.750431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.750909 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:59:07.751498 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.752109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.752724 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.753303 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.753896 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.754512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.755099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.755721 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.756302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.756871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.757532 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.758056 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.758623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.759208 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.759837 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.760471 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.761055 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.761634 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.762207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.762754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.763354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.763994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.764615 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.765189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.765804 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.766426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.766899 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.767496 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.768127 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.768720 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.769305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.769900 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.770473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.770926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.771099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Registered counter for database nova_api Jul 26 04:59:07.771256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.771688 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.772249 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.772921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.773512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.774081 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.774631 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.775216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.775762 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.776323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.776914 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.779604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.779604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.779604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.779604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.780290 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.780432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.780968 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.781735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.782284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.782872 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.783493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.784114 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.784719 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.785290 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.785880 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.786433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.786994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.787532 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.788159 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.788760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.789421 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.789930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.790496 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.793459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.793459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.793459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.793459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.793459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.793927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.794421 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.794992 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.795104 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:07.795577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.796171 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.796742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.797331 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.797958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.798567 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.799010 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.799474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.799906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.800321 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.800644 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.800969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.801374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.801911 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.802427 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.802656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:07.802945 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.803473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.804098 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.804648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.805192 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.805739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.806356 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.806926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.807492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.808085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.808647 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.809288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.809852 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.810481 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.811073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.811693 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.812465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.812854 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.813431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.814007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.814597 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.815164 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.815763 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.816363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.816927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.817514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.818073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.818656 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.819236 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.819915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.820509 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.821112 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.821781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.822354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.822962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.823539 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.824160 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.824678 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.825247 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.825813 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.826392 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.826940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.827291 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.827683 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.828180 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.828766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.829372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.830286 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.830826 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.831370 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.831995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.832647 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.833262 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.833813 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.834412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.834983 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.835646 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.836219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.836803 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.837353 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.837936 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.839336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.839336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.840018 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.840566 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.841114 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.841699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.842268 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.842781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.843300 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.843906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.844503 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.845068 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.845709 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.846216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.846747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.847297 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.847791 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.848284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.848836 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.849396 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.849988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.850623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.851181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.851817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.852383 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.852964 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.853545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.854117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.854707 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.855292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.855923 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.856494 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.857032 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.857567 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.858094 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.858661 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.859222 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.859853 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.860410 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.860964 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.861536 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.861909 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.862288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.862770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.863156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.context [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81272727-2a60-4ee7-8404-1f09619562b8(cell1) {{(pid=117994) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:59:07.863850 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.864429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.864983 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.865548 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.866115 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.866751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.867364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.867976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.868551 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.869117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.869229 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:07.869677 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.870253 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.870818 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.871353 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.871726 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:07.871934 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.872486 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.872854 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:07.873039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.873611 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.874188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.874771 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.875355 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.875943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.876654 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:07.876796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.877035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.877593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.878411 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.879010 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.879634 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.880209 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.880475 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Registered counter for database nova_cell0 Jul 26 04:59:07.883121 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.884740 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.885133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.888518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.889619 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.889788 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.890304 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.890871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.891450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.891715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Registered counter for database nova_cell1 Jul 26 04:59:07.892067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.892628 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.893191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.893748 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.894330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.895055 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.895479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.896107 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902870 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:07.902965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.902965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.903440 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:07.903605 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.904085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.904637 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.905226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.905805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.906383 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.906924 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.907484 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.907959 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.908291 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.908647 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.909186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.909748 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.910314 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.910885 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.911451 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.912032 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.912569 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:07.912668 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.913200 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.913824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.914385 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.914946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.915524 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.916142 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.916691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.917257 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.917821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.918392 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.918946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.919531 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.920114 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.920646 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.921157 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.921696 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.922248 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.922466 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:07.922801 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.923417 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.923995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.924654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.925222 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.925826 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.926418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.927012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.927620 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.928206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.928772 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.930671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.931205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.931653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.931989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.932314 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.932660 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.932989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.933320 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.933653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.933988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.934320 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.934632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.934952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.935271 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.935610 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.935938 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.936256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.936575 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.936893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.937210 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.937528 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.937840 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.938160 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.938469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.938782 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.939092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.939538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.939875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.940632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.940632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.940903 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.941094 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.941401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.941852 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.942173 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.942489 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.942798 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.943114 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.943428 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.943774 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.944099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.944405 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.944886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.945202 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.945515 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.945828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.946136 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.946442 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.946754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.947081 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.947389 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.947721 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.948030 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.948364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.948669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.948991 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.949424 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.949742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.950050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.950468 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.950782 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.951095 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.951418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.951767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.952094 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.952400 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.952716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.953030 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.953356 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.953682 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.954003 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.954326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.954977 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.955302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.955651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.955971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.956295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.956734 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.957057 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.957370 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.957695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.958024 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.958330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.958666 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.958978 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.959281 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.959588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.959936 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.960295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.960639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.960948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.961257 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.961559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.961844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.962159 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.962467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.962790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.963110 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.963433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.963779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.964086 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.964414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.965072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.965388 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.965695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.966001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.966467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.966776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.967100 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.967434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.967803 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.968116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.968449 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.968783 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.969101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.969418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.969744 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.970049 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.970349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.970659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.970963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.971265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.971623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.971895 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.972198 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.972505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.972804 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.973126 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.973429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.973744 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.974052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.974354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.974662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.974963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.975306 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.975634 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.976019 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.976342 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.976663 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.977004 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.977319 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.977642 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.977959 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.978273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.978587 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.978906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.979241 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.979623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.979895 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.980206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.980521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.980832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.981147 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.981725 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.982051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.982364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.982677 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.982991 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.983301 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.983635 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.983952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.984264 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.984574 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.984886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.985214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.985538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.985863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.986200 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.986521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.986837 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.987149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.987465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.987849 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.988162 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.988469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.988781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.989101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.989414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.989738 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.990041 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.990357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.990668 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.990980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.991291 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.991871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.992187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.992610 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.992852 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.993174 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.993511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.993827 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.994143 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.994712 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.995031 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.995362 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.995713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.996039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.996354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.996675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.997002 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.997303 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.997592 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.997903 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.998214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.998514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.998839 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.999150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.999453 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:07.999802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.000112 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.000687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.001039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.001354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.001683 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.002006 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.002306 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.002753 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.002935 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.003240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.003542 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.003879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.004189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.004491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.004793 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.005105 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.005412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.005715 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.006023 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.006324 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.006651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.006956 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.007316 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.007650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.007964 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.008268 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.008571 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.008876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.009178 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.009498 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.009799 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.010109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.010411 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.010721 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.011023 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.011332 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.011714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.012045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.012352 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.012656 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.012987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.013412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.013736 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.014050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.014361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.014715 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.015031 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.015671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.016010 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.016330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.016670 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.017009 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.017306 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.017611 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.017915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.018241 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.018552 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.018860 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.019170 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.019487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.019823 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.020131 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.020443 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.020752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.021061 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.021369 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.021676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.021982 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.022290 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.022606 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.023055 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.023370 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.023711 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.024028 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.024344 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.024653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.024961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.025274 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.025580 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.025890 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.026219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.026529 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.026835 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.027270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.027607 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.027930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.028252 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.028559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.028875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.029199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.029515 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.029830 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.030168 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.030467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.030806 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.031131 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.031451 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.031776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.032078 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.032381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.032687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.033005 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.033317 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.033616 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.033918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.034228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.034530 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.034833 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.035135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.035438 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.035768 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.036071 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.036374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.036675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.036976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.037277 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.037578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.037887 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.038188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.038548 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.038846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.039147 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.039453 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.039811 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.040144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.040461 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.040781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.041091 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.041409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.041716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.042035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.042358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.042676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.042985 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.043331 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.043664 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.043978 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.044284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.044594 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.044906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.045216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.045542 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.045864 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.046167 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.046492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.046809 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.047129 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.047443 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.047775 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.048105 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.048414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.048730 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.049039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.049353 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.049659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.049975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.050282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.050588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.050905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.051215 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.051572 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.051883 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.052192 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.052514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.052837 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.053189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.053537 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.053854 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.054262 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.054577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.054882 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.055186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:59:08.055432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:59:08.118667 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Registered counter for database nova_api Jul 26 04:59:08.142351 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:08.150031 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:08.167104 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO dbcounter [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Registered counter for database nova_cell0 Jul 26 04:59:08.180247 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_db.sqlalchemy.engines [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:08.187831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writer thread running {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:08.208716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.context [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81272727-2a60-4ee7-8404-1f09619562b8(cell1) {{(pid=117993) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 04:59:08.213175 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:08.214869 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:08.215751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 04:59:08.217972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 04:59:08.220143 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Registered counter for database nova_cell0 Jul 26 04:59:08.224710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Registered counter for database nova_cell1 Jul 26 04:59:08.233552 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:08.235899 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:08.243497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:08.245150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:08.399539 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Registered counter for database nova_cell0 Jul 26 04:59:08.411629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:59:08.417591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:59:08.584477 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:59:08.592254 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:59:08.777121 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:59:08.792625 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:59:08.933587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:59:08.939706 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: WARNING keystonemiddleware.auth_token [None req-70942cbb-dc26-4147-9696-054b0546d779 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:59:08.945154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d714ab59c0 pid: 117994 (default app) Jul 26 04:59:09.380976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 04:59:09.387972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-7ea0ca1c-f273-4fcc-ae9c-6e37b89942ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 04:59:09.393416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d714ab59c0 pid: 117993 (default app) Jul 26 04:59:52.419642 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:52.420759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:52.421777 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:52.422721 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:52.848157 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:52.849240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:52.849970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:52.851969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:53.805864 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f993049f-3583-45b5-bb4d-6563f0df6912 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Action: 'create', calling method: .version_select at 0x7f0e9718a940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1309091314", "metadata": {"Type": "work"}}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f993049f-3583-45b5-bb4d-6563f0df6912 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Request method failure captured: Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 122 Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TIuyLx5LdZ-zRETP-eX_TgBGMJUCFxyqUbK6ifSz0YX_qzKe2hFBre-H2dOG8bFlizaJ2bm3zNytHztzC_BDjguSivhLIuPNcDZ-8lWTOdYCa-KcogiH5TPNLCXunoQP5ryCNySjgN5u7vRJgeCfpVvy_dDNfxWvkFQUH30p4-4Fs Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 04:59:53.848644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}] Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92a01d413b71400da5885d4ea44ec03a Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1309091314", "metadata": {"Type": "work"}}} Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 04:59:53.852452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1309091314', 'metadata': {'Type': 'work'}}}} Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:53.854416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:59:53.858193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:59:53.860902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 04:59:53.860902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.864878 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f993049f-3583-45b5-bb4d-6563f0df6912 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:53.868238 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f993049f-3583-45b5-bb4d-6563f0df6912 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.461482 Jul 26 04:59:53.873295 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Jul 26 04:59:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1469 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:59:53.922734 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-881e0ff0-9dd2-45ab-8a26-b188f52bc258 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Action: 'create', calling method: .version_select at 0x7f0e9718a9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1985007073", "metadata": {"Type": "work"}}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-881e0ff0-9dd2-45ab-8a26-b188f52bc258 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Request method failure captured: Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 120 Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TIuyLx5LdZ-zRETP-eX_TgBGMJUCFxyqUbK6ifSz0YX_qzKe2hFBre-H2dOG8bFlizaJ2bm3zNytHztzC_BDjguSivhLIuPNcDZ-8lWTOdYCa-KcogiH5TPNLCXunoQP5ryCNySjgN5u7vRJgeCfpVvy_dDNfxWvkFQUH30p4-4Fs Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 04:59:53.940779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}] Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92a01d413b71400da5885d4ea44ec03a Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1985007073", "metadata": {"Type": "work"}}} Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 04:59:53.942517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1985007073', 'metadata': {'Type': 'work'}}}} Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi '0' Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:53.943541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:59:53.945137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:59:53.946377 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 04:59:53.946377 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.948384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-881e0ff0-9dd2-45ab-8a26-b188f52bc258 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:53.955008 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-881e0ff0-9dd2-45ab-8a26-b188f52bc258 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.074597 Jul 26 04:59:53.956148 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Jul 26 04:59:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:59:53.970839 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f43c8cf8-3931-4f8e-98b8-359778dec69e tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Action: 'create', calling method: .version_select at 0x7f0e970444c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1423363909", "metadata": {"Type": "work"}}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f43c8cf8-3931-4f8e-98b8-359778dec69e tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Request method failure captured: Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 119 Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TIuyLx5LdZ-zRETP-eX_TgBGMJUCFxyqUbK6ifSz0YX_qzKe2hFBre-H2dOG8bFlizaJ2bm3zNytHztzC_BDjguSivhLIuPNcDZ-8lWTOdYCa-KcogiH5TPNLCXunoQP5ryCNySjgN5u7vRJgeCfpVvy_dDNfxWvkFQUH30p4-4Fs Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 04:59:53.984035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}] Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92a01d413b71400da5885d4ea44ec03a Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1423363909", "metadata": {"Type": "work"}}} Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 04:59:53.985666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1423363909', 'metadata': {'Type': 'work'}}}} Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise error Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi '' Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:53.986451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 04:59:53.987843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 04:59:53.988921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 04:59:53.988921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:53.988921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f43c8cf8-3931-4f8e-98b8-359778dec69e tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:53.988921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f43c8cf8-3931-4f8e-98b8-359778dec69e tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018779 Jul 26 04:59:53.988921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Jul 26 04:59:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 04:59:54.041139 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8a8fcbbe-f583-4936-9197-25311eef9372 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Calling method '.version_select at 0x7f0e97044ee0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:54.326775 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6e62ba51-9107-4907-b3d7-c4fe2824124f tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Action: 'create', calling method: .version_select at 0x7f0e9718a940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-518660580", "metadata": {"Type": "work"}}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 04:59:54.541729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-8a8fcbbe-f583-4936-9197-25311eef9372 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] HTTP exception thrown: Volume tempest-invalid-1382895903 could not be found. Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8a8fcbbe-f583-4936-9197-25311eef9372 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Request method failure captured: Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1382895903 HTTP/1.1 Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TIuyLx5LdZ-zRETP-eX_TgBGMJUCFxyqUbK6ifSz0YX_qzKe2hFBre-H2dOG8bFlizaJ2bm3zNytHztzC_BDjguSivhLIuPNcDZ-8lWTOdYCa-KcogiH5TPNLCXunoQP5ryCNySjgN5u7vRJgeCfpVvy_dDNfxWvkFQUH30p4-4Fs Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 04:59:54.545956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}] Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92a01d413b71400da5885d4ea44ec03a Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Volume tempest-invalid-1382895903 could not be found. Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'tempest-invalid-1382895903'} Jul 26 04:59:54.547600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1382895903 could not be found. (HTTP 404) (Request-ID: req-e1f0e3d4-cdc8-4d11-9f83-899926d2d03a) Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:54.548500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 04:59:54.550507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1382895903 could not be found. Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:54.552250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1382895903 could not be found. Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1382895903 could not be found. Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8a8fcbbe-f583-4936-9197-25311eef9372 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Returning 404 to user: Volume tempest-invalid-1382895903 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8a8fcbbe-f583-4936-9197-25311eef9372 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1382895903" status: 404 len: 99 microversion: 2.1 time: 0.550263 Jul 26 04:59:54.553598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Jul 26 04:59:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1382895903 => generated 99 bytes in 556 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 04:59:54.566905 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b6725d44-a112-4d3b-ba2c-f9cd5cdc0dea tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009030 Jul 26 04:59:54.568557 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 5/5] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Jul 26 04:59:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 04:59:54.584301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d712be4c-f37b-4bbc-a5f1-56bf2a2a7de8 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007256 Jul 26 04:59:54.586331 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1137 bytes} [Tue Jul 26 04:59:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 26 04:59:54.597430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c32b578-dd71-429d-a384-72577c32af59 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Calling method '.version_select at 0x7f0e96f74790>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:54.898439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-5c32b578-dd71-429d-a384-72577c32af59 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] HTTP exception thrown: Volume fc60cb7d-5276-44c3-8d2b-4d34e50fd071 could not be found. Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c32b578-dd71-429d-a384-72577c32af59 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Request method failure captured: Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/os-volumes/fc60cb7d-5276-44c3-8d2b-4d34e50fd071 HTTP/1.1 Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TIuyLx5LdZ-zRETP-eX_TgBGMJUCFxyqUbK6ifSz0YX_qzKe2hFBre-H2dOG8bFlizaJ2bm3zNytHztzC_BDjguSivhLIuPNcDZ-8lWTOdYCa-KcogiH5TPNLCXunoQP5ryCNySjgN5u7vRJgeCfpVvy_dDNfxWvkFQUH30p4-4Fs Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 04:59:54.901518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}] Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92a01d413b71400da5885d4ea44ec03a Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Volume fc60cb7d-5276-44c3-8d2b-4d34e50fd071 could not be found. Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'fc60cb7d-5276-44c3-8d2b-4d34e50fd071'} Jul 26 04:59:54.904081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc60cb7d-5276-44c3-8d2b-4d34e50fd071 could not be found. (HTTP 404) (Request-ID: req-5753a1f1-6def-45cd-9780-bc644fe798bc) Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:54.905897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 04:59:54.908759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc60cb7d-5276-44c3-8d2b-4d34e50fd071 could not be found. Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 04:59:54.913319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc60cb7d-5276-44c3-8d2b-4d34e50fd071 could not be found. Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc60cb7d-5276-44c3-8d2b-4d34e50fd071 could not be found. Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c32b578-dd71-429d-a384-72577c32af59 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Returning 404 to user: Volume fc60cb7d-5276-44c3-8d2b-4d34e50fd071 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c32b578-dd71-429d-a384-72577c32af59 tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/fc60cb7d-5276-44c3-8d2b-4d34e50fd071" status: 404 len: 109 microversion: 2.1 time: 0.309673 Jul 26 04:59:54.918688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 7/7] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 04:59:54 2022] DELETE /compute/v2.1/os-volumes/fc60cb7d-5276-44c3-8d2b-4d34e50fd071 => generated 109 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:59:54.923332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1118d008-62dc-4e03-89e7-88461fb0dd0a tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Calling method '.version_select at 0x7f0e96f74310>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:55.001763 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-1118d008-62dc-4e03-89e7-88461fb0dd0a tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] HTTP exception thrown: Volume 1c2ed732-b20e-4d54-954b-29cda6db1dcf could not be found. Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1118d008-62dc-4e03-89e7-88461fb0dd0a tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Request method failure captured: Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/os-volumes/1c2ed732-b20e-4d54-954b-29cda6db1dcf HTTP/1.1 Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TIuyLx5LdZ-zRETP-eX_TgBGMJUCFxyqUbK6ifSz0YX_qzKe2hFBre-H2dOG8bFlizaJ2bm3zNytHztzC_BDjguSivhLIuPNcDZ-8lWTOdYCa-KcogiH5TPNLCXunoQP5ryCNySjgN5u7vRJgeCfpVvy_dDNfxWvkFQUH30p4-4Fs Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 04:59:55.004081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8653b1f3efea450dae2a0881cb757c86"}]}] Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 8653b1f3efea450dae2a0881cb757c86 Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-1263733302 Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92a01d413b71400da5885d4ea44ec03a Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-1263733302-project Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Volume 1c2ed732-b20e-4d54-954b-29cda6db1dcf could not be found. Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '1c2ed732-b20e-4d54-954b-29cda6db1dcf'} Jul 26 04:59:55.005354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1c2ed732-b20e-4d54-954b-29cda6db1dcf could not be found. (HTTP 404) (Request-ID: req-722a9b73-843a-43a3-911d-648bfd809933) Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:55.006197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:59:55.007288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1c2ed732-b20e-4d54-954b-29cda6db1dcf could not be found. Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 04:59:55.008794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1c2ed732-b20e-4d54-954b-29cda6db1dcf could not be found. Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1c2ed732-b20e-4d54-954b-29cda6db1dcf could not be found. Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1118d008-62dc-4e03-89e7-88461fb0dd0a tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] Returning 404 to user: Volume 1c2ed732-b20e-4d54-954b-29cda6db1dcf could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1118d008-62dc-4e03-89e7-88461fb0dd0a tempest-VolumesNegativeTest-1263733302 tempest-VolumesNegativeTest-1263733302-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1c2ed732-b20e-4d54-954b-29cda6db1dcf" status: 404 len: 109 microversion: 2.1 time: 0.092861 Jul 26 04:59:55.010052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 8/8] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:54 2022] GET /compute/v2.1/os-volumes/1c2ed732-b20e-4d54-954b-29cda6db1dcf => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 04:59:55.449671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6e62ba51-9107-4907-b3d7-c4fe2824124f tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.604892 Jul 26 04:59:55.462672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 1/9] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Jul 26 04:59:52 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2621 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 04:59:55.472829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16d0ff0c-7b50-458b-af38-e3c8862a4a0e tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Calling method '.version_select at 0x7f0e96fc1c10>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:55.591089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16d0ff0c-7b50-458b-af38-e3c8862a4a0e tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b" status: 200 len: 352 microversion: 2.1 time: 0.126349 Jul 26 04:59:55.591695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 9/10] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:55 2022] GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:56.378288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-16e09c1e-8b8a-4637-8a31-f2a787f7b902 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96fde790>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:56.516571 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-16e09c1e-8b8a-4637-8a31-f2a787f7b902 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c97a323c-f187-4337-9985-e7c8498895c2" status: 200 len: 351 microversion: 2.1 time: 0.144198 Jul 26 04:59:56.518422 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 2/11] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:56 2022] GET /compute/v2.1/os-volumes/c97a323c-f187-4337-9985-e7c8498895c2 => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:56.611782 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-056b8412-42c5-480b-8ee4-9c8995185c91 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Calling method '.version_select at 0x7f0e96f74700>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:56.766855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-056b8412-42c5-480b-8ee4-9c8995185c91 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b" status: 200 len: 353 microversion: 2.1 time: 0.140308 Jul 26 04:59:56.766855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 10/12] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:56 2022] GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:56.775592 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-217f5b33-2543-4a58-80c2-582ad0ef8e41 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Calling method '.version_select at 0x7f0e96fdeee0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:56.918484 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-217f5b33-2543-4a58-80c2-582ad0ef8e41 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b" status: 200 len: 353 microversion: 2.1 time: 0.161228 Jul 26 04:59:56.919270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 3/13] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:56 2022] GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 04:59:56.938888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-eeb66e5e-1b60-4c2a-8aeb-e04066a3e422 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Calling method '.version_select at 0x7f0e96f74280>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:57.107116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-eeb66e5e-1b60-4c2a-8aeb-e04066a3e422 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b" status: 202 len: 0 microversion: 2.1 time: 0.171748 Jul 26 04:59:57.109089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 11/14] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 04:59:56 2022] DELETE /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 04:59:57.124619 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-78a9c73e-1123-4a8f-9ed1-e5ddb1bc048e tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Calling method '.version_select at 0x7f0e96ff55e0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:57.281350 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-78a9c73e-1123-4a8f-9ed1-e5ddb1bc048e tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b" status: 200 len: 352 microversion: 2.1 time: 0.165594 Jul 26 04:59:57.286542 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 4/15] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:57 2022] GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 04:59:58.309507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2a2133f5-9e35-4422-9736-c66d11fc11c3 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Calling method '.version_select at 0x7f0e96f833a0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:58.377119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-2a2133f5-9e35-4422-9736-c66d11fc11c3 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] HTTP exception thrown: Volume ef1fa4e1-fa23-42cb-9d85-195164aaf54b could not be found. Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2a2133f5-9e35-4422-9736-c66d11fc11c3 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Request method failure captured: Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b HTTP/1.1 Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TI7NAkkjcQTHOjk7XjvaUX0jb3m7TVHOvTl497zCm6tU7yeUeUBC5S1kKRTRZczr7mci4ZRlLwspbQ96myr5qNvixSClAeg8ZTM3RMqwSsl5Iss5SAeSuKYjFu4ebywJtgMwgGRfsWUR1tsmNO1wGHtegl2HpY57bIDfq1w3mMHUg Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: f797e5a15e8b4bc887794be8dc622961 Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesGetTestJSON-979957243 Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 04:59:58.406505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f797e5a15e8b4bc887794be8dc622961"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f797e5a15e8b4bc887794be8dc622961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f797e5a15e8b4bc887794be8dc622961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f797e5a15e8b4bc887794be8dc622961"}]}] Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesGetTestJSON-979957243 Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: f797e5a15e8b4bc887794be8dc622961 Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesGetTestJSON-979957243 Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesGetTestJSON-979957243-project Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: c84bbfe30cb04dd5adcd67987e31412d Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesGetTestJSON-979957243-project Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Volume ef1fa4e1-fa23-42cb-9d85-195164aaf54b could not be found. Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'ef1fa4e1-fa23-42cb-9d85-195164aaf54b'} Jul 26 04:59:58.409012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef1fa4e1-fa23-42cb-9d85-195164aaf54b could not be found. (HTTP 404) (Request-ID: req-81dd597c-7150-4ab0-87e1-0bb53d0e067c) Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:58.410384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 04:59:58.412473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef1fa4e1-fa23-42cb-9d85-195164aaf54b could not be found. Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 04:59:58.414608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef1fa4e1-fa23-42cb-9d85-195164aaf54b could not be found. Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef1fa4e1-fa23-42cb-9d85-195164aaf54b could not be found. Jul 26 04:59:58.417809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 04:59:58.425097 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2a2133f5-9e35-4422-9736-c66d11fc11c3 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] Returning 404 to user: Volume ef1fa4e1-fa23-42cb-9d85-195164aaf54b could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 04:59:58.433850 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2a2133f5-9e35-4422-9736-c66d11fc11c3 tempest-VolumesGetTestJSON-979957243 tempest-VolumesGetTestJSON-979957243-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b" status: 404 len: 109 microversion: 2.1 time: 0.128327 Jul 26 04:59:58.437842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 12/16] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:58 2022] GET /compute/v2.1/os-volumes/ef1fa4e1-fa23-42cb-9d85-195164aaf54b => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:58.769340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a6af82d7-3388-4c23-add9-4adf3993fdda tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96fdec10>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 04:59:58.887498 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a6af82d7-3388-4c23-add9-4adf3993fdda tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/ea5ba378-17b9-4a8b-9d83-79c47c70ee42" status: 200 len: 351 microversion: 2.1 time: 0.121865 Jul 26 04:59:58.888151 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 5/17] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 04:59:58 2022] GET /compute/v2.1/os-volumes/ea5ba378-17b9-4a8b-9d83-79c47c70ee42 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:00:00.974934 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cf1eb938-e0f8-45c3-9ef1-f7a3537baea2 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96f743a0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:01.493926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cf1eb938-e0f8-45c3-9ef1-f7a3537baea2 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/11898d3b-b1eb-46b0-8795-692663d31060" status: 200 len: 351 microversion: 2.1 time: 0.523531 Jul 26 05:00:01.495102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 13/18] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 05:00:00 2022] GET /compute/v2.1/os-volumes/11898d3b-b1eb-46b0-8795-692663d31060 => generated 351 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:01.508831 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a6a54524-1fdb-4fc3-8cb2-6e0453bd4d0e tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96fde550>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:01.844423 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a6a54524-1fdb-4fc3-8cb2-6e0453bd4d0e tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.339726 Jul 26 05:00:01.854490 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 6/19] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Jul 26 05:00:01 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:01.861054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fb1280d3-fea9-45c5-9edd-2e1e54d63041 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96fc1dc0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.057251 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fb1280d3-fea9-45c5-9edd-2e1e54d63041 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.200745 Jul 26 05:00:02.057928 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 14/20] 10.222.0.17 () {58 vars in 1149 bytes} [Tue Jul 26 05:00:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:02.072817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b9f546cc-6234-4be1-b30b-76af2f6a8a3e tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96ffe040>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.246171 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b9f546cc-6234-4be1-b30b-76af2f6a8a3e tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.176739 Jul 26 05:00:02.247399 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 7/21] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:02.270511 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0e7f55bc-2484-48f4-ae80-a1100f8ebed0 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e970503a0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.461549 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0e7f55bc-2484-48f4-ae80-a1100f8ebed0 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203678 Jul 26 05:00:02.462416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 15/22] 10.222.0.17 () {58 vars in 1167 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:02.479919 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a8ab9f47-ca37-4318-9649-5c36a71bdc61 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96fde700>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.756015 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a8ab9f47-ca37-4318-9649-5c36a71bdc61 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.283633 Jul 26 05:00:02.756593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 8/23] 10.222.0.17 () {58 vars in 1170 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:02.770100 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-731855d9-6a3d-49ab-a255-61c4e849f850 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96f74dc0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:02.946057 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-731855d9-6a3d-49ab-a255-61c4e849f850 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.179248 Jul 26 05:00:02.947497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 16/24] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:02.963709 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-53e56e10-5468-495f-8ff9-9f059ec91236 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96ff53a0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:03.179275 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-53e56e10-5468-495f-8ff9-9f059ec91236 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.221594 Jul 26 05:00:03.180179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 9/25] 10.222.0.17 () {58 vars in 1188 bytes} [Tue Jul 26 05:00:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:03.198382 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b32677d0-f486-46b8-8626-81aadc3e5712 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] Calling method '.version_select at 0x7f0e96f871f0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:03.461201 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b32677d0-f486-46b8-8626-81aadc3e5712 tempest-VolumesTestJSON-764831911 tempest-VolumesTestJSON-764831911-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.271014 Jul 26 05:00:03.463145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 17/26] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Jul 26 05:00:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:07.319360 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9aa26c2b-afbc-4ae3-a3f4-2de5d7a8f3bf tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'create', calling method: .version_select at 0x7f0e96ffe550>, body: {"keypair": {"name": "tempest-keypair-1159963161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtMPOOguLjm13nQwjCs/08zmd5uGO+z5WzMK8OZlw0/8MOHeXyga3OChl4xHYvPqrSDbGOqQA8MWCGRevxNNF+0Cz4m0JnMi8xOLVN0LL1c8S62Z4u6RP+/ef520dsybQ=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:07.444001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-9aa26c2b-afbc-4ae3-a3f4-2de5d7a8f3bf tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for project 27187d178a5f47b49035991ab566c2d9. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:07.466161 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-9aa26c2b-afbc-4ae3-a3f4-2de5d7a8f3bf tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for user f996bed3f6064c6dbf04d26c7c04df7c and project 27187d178a5f47b49035991ab566c2d9. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:07.609123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9aa26c2b-afbc-4ae3-a3f4-2de5d7a8f3bf tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.603759 Jul 26 05:00:07.611160 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 10/27] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Jul 26 05:00:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 609 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 05:00:12.677113 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-175533004", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b59dfcee-9319-4218-b70b-67be8305e37d"}], "security_groups": [{"name": "tempest-securitygroup--1711191046"}], "key_name": "tempest-keypair-1159963161", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:13.359951 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] validate_networks() for [('b59dfcee-9319-4218-b70b-67be8305e37d', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:00:13.927198 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-36bcedad-91db-4355-b255-7ab8b77e01ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'create', calling method: .version_select at 0x7f0e96f5e040>, body: {"keypair": {"name": "tempest-keypair-912349614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMcP9VPnfzhXRwyxpoFKBA6FW9gHIQNbCgoPQnDxeGzlOGt73Fz5LlYj/cD0LvSmwytQgf6k1jqZsblVdj3cV7OrCpqZCnWUP19VFz6EBotsg6svX8q0yHvVYDEpJ+lyw=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:13.990774 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-36bcedad-91db-4355-b255-7ab8b77e01ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for project 9747c4b81e8844e989d70b8001a196b0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:14.003971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-36bcedad-91db-4355-b255-7ab8b77e01ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for user 39de5897bd2d4e2b91c05d8dda5827be and project 9747c4b81e8844e989d70b8001a196b0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:14.084563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-36bcedad-91db-4355-b255-7ab8b77e01ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.870267 Jul 26 05:00:14.089461 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 11/28] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:00:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:16.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:00:16.321279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:00:16.328581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:00:16.329207 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:00:16.330933 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:00:16.365767 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:16.368454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:16.369468 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:16.374791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:16.498640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for project 27187d178a5f47b49035991ab566c2d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:16.552981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for user f996bed3f6064c6dbf04d26c7c04df7c and project 27187d178a5f47b49035991ab566c2d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:16.616761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:00:16.624573 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:00:16.959737 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-59e390a2-07d7-4343-a8b5-66fe870781f9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.296094 Jul 26 05:00:16.963538 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 18/29] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Jul 26 05:00:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 4299 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 05:00:16.972282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-51d5d930-64b3-41c1-9318-5f82e107fa88 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:16.973097 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-51d5d930-64b3-41c1-9318-5f82e107fa88 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:17.485665 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-51d5d930-64b3-41c1-9318-5f82e107fa88 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:17.512790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-51d5d930-64b3-41c1-9318-5f82e107fa88 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:17.516174 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-51d5d930-64b3-41c1-9318-5f82e107fa88 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:17.534465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-51d5d930-64b3-41c1-9318-5f82e107fa88 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1281 microversion: 2.20 time: 0.564559 Jul 26 05:00:17.535824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 12/30] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:16 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1281 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:18.568619 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a5398421-4949-4fca-96e9-ede2139849cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:18.569582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a5398421-4949-4fca-96e9-ede2139849cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:18.969488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5398421-4949-4fca-96e9-ede2139849cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:19.021898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5398421-4949-4fca-96e9-ede2139849cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:19.026072 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5398421-4949-4fca-96e9-ede2139849cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:19.027645 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a5398421-4949-4fca-96e9-ede2139849cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1281 microversion: 2.20 time: 0.470023 Jul 26 05:00:19.040039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 19/31] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:18 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1281 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:19.795537 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-759684608", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41d26926-2f73-4071-bfbf-1d55e6f46e9c"}], "security_groups": [{"name": "tempest-securitygroup--1160847765"}], "key_name": "tempest-keypair-912349614", "user_data": "}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:20.069794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:20.070418 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:20.079674 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:20.082170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:20.083069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:20.090421 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:20.419288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] validate_networks() for [('41d26926-2f73-4071-bfbf-1d55e6f46e9c', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:00:20.972850 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:21.030058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:21.043427 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:21.050067 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7fb9ceff-c4b0-4a8c-a339-430b919c9da2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1285 microversion: 2.20 time: 0.984903 Jul 26 05:00:21.051408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 20/32] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:20 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1285 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:00:21.487527 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1384858641", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "networks": [{"uuid": "52bd74bd-39e1-48e8-89c9-cce057dd1ff3"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:21.591761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] validate_networks() for [('52bd74bd-39e1-48e8-89c9-cce057dd1ff3', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:00:23.501970 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:00:23.502616 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:00:23.502841 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:00:23.503245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:00:23.503708 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:00:23.517295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:00:23.517820 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:00:23.518175 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:00:23.518576 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:00:23.518980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:00:23.531769 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.534637 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.534919 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.537778 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.538279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.538685 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.539046 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.539160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.591882 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for project 9747c4b81e8844e989d70b8001a196b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:23.597257 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for user 39de5897bd2d4e2b91c05d8dda5827be and project 9747c4b81e8844e989d70b8001a196b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:23.600784 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Getting quotas for project 981b76b8fd394154a07921073ab08ed6. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:23.618129 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:00:23.625919 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Getting quotas for user f4e86ac513aa4feda193e134c0bc9e79 and project 981b76b8fd394154a07921073ab08ed6. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:23.627944 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:00:23.668614 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:00:23.677349 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:00:23.829822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-97feca30-064b-4006-821e-59b3d7f99afb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.772511 Jul 26 05:00:23.831956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 21/33] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:00:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:00:23.849395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:23.861384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:23.904124 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.913454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.917654 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:23.919373 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:23.930021 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fb34df62-6753-4d47-af60-5143a96276ff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.150720 Jul 26 05:00:23.937205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 13/34] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:00:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 4159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:00:23.943194 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-96a46bc5-2ccd-4afc-94f7-c348f1179fde tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:23.958409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-96a46bc5-2ccd-4afc-94f7-c348f1179fde tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:24.272442 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:24.322718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:24.334847 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:24.336904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bdc6a4c9-6e3a-4abe-9045-9db3e7b2a364 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1339 microversion: 2.20 time: 0.501172 Jul 26 05:00:24.349311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 22/35] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:23 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1339 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:24.373952 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e2e519a4-9a01-40b3-b10c-3c3b34fa242f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:24.386872 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e2e519a4-9a01-40b3-b10c-3c3b34fa242f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:24.699087 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e2e519a4-9a01-40b3-b10c-3c3b34fa242f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:24.718631 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e2e519a4-9a01-40b3-b10c-3c3b34fa242f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1236 microversion: 2.1 time: 0.360524 Jul 26 05:00:24.721383 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 23/36] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:24 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1236 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:24.731685 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-96a46bc5-2ccd-4afc-94f7-c348f1179fde tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:24.740626 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-96a46bc5-2ccd-4afc-94f7-c348f1179fde tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1215 microversion: 2.1 time: 0.801970 Jul 26 05:00:24.760985 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 14/37] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:23 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1215 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:25.377163 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:25.377778 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:25.415117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:25.423910 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:25.426154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:25.429503 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:25.751529 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b118285c-dfeb-450f-932e-4855e6cc8b6a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:25.755678 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b118285c-dfeb-450f-932e-4855e6cc8b6a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:25.983114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:26.023924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:26.052135 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:26.062074 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4c059e1e-c644-4bbd-bf75-e7d34a2d664f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1339 microversion: 2.20 time: 0.688942 Jul 26 05:00:26.062692 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 24/38] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:25 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1339 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:26.098933 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-83e81182-f33b-4699-8b0e-5160e5025f9d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:26.106732 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-83e81182-f33b-4699-8b0e-5160e5025f9d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:26.188296 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b118285c-dfeb-450f-932e-4855e6cc8b6a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:26.198058 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b118285c-dfeb-450f-932e-4855e6cc8b6a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1236 microversion: 2.1 time: 0.454581 Jul 26 05:00:26.207994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 15/39] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:25 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1236 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:26.454625 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-83e81182-f33b-4699-8b0e-5160e5025f9d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:26.464036 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-83e81182-f33b-4699-8b0e-5160e5025f9d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1215 microversion: 2.1 time: 0.391742 Jul 26 05:00:26.468807 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 25/40] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:26 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1215 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:27.089692 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:27.092009 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:27.126666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.127158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:27.128012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.128449 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:27.416523 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:27.433322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:27.435907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:27.439392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c06e4d42-a9ae-4146-8d0b-777d29618ba9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1339 microversion: 2.20 time: 0.356817 Jul 26 05:00:27.456613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 26/41] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:27 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1339 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:27.464373 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:27.465483 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:27.473612 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.474381 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:27.475642 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:27.476874 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:27.577927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1146412490", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:27.720587 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] validate_networks() for [('94dd837e-81c9-4e2e-9135-742712cb9531', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:00:28.282485 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:28.336763 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a1038853-cfc1-41a9-9e6c-c08ac4b20fed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1288 microversion: 2.1 time: 0.878258 Jul 26 05:00:28.340515 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 27/42] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:27 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1288 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:28.353058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:28.364824 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:28.398982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:28.414267 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:28.416131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:28.418771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:28.925154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:28.945141 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4e7bd5c0-93ba-4294-a31b-1308aacdf6d1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1211 microversion: 2.1 time: 0.603083 Jul 26 05:00:28.945777 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 28/43] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:28 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1211 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:28.996087 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:28.999359 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:29.016959 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:29.024808 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:29.029830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:29.035709 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:29.345939 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:29.386471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:29.390822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:29.407419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-45c91e71-16a8-4490-8a80-eb75337ef673 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1339 microversion: 2.20 time: 0.441139 Jul 26 05:00:29.410835 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 29/44] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:28 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1339 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:29.428890 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:29.431382 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:29.469692 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:29.470595 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:29.475430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:29.479597 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:29.902697 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:29.933420 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b42015d1-d637-4007-bbe2-7755ea6947c6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1294 microversion: 2.1 time: 0.519890 Jul 26 05:00:29.969907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 30/45] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:29 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1294 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:29.985367 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:29.986272 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:30.029913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.037520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:30.039649 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.042455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:30.506309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:00:30.507430 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:00:30.508659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:00:30.509579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:00:30.510341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:00:30.535258 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.536547 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:30.539636 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.540619 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:30.626072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for project 1c772e5c90114978ad92818d58ca11c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:30.637106 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for user f0cc1af7d7d642889a1a11103f087e79 and project 1c772e5c90114978ad92818d58ca11c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:30.658404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:30.689469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e88e51ff-cf41-4fc6-b3a6-49275bcd8b4a tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1285 microversion: 2.1 time: 0.717408 Jul 26 05:00:30.695536 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 31/46] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:29 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1285 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:30.701022 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:30.709648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:00:30.713743 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:30.717525 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:00:30.725936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.726392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:30.727249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:30.727742 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:30.857317 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6548c799-e1c8-401e-82f4-1a20dbfc27bc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.017681 Jul 26 05:00:30.880465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 16/47] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:00:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 4041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:00:30.908025 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f4e1e9e1-defa-4c36-a353-98614d7b9c56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:30.918444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f4e1e9e1-defa-4c36-a353-98614d7b9c56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:31.185732 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f4e1e9e1-defa-4c36-a353-98614d7b9c56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:31.197609 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f4e1e9e1-defa-4c36-a353-98614d7b9c56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1222 microversion: 2.1 time: 0.315350 Jul 26 05:00:31.203271 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 17/48] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:30 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1222 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:31.210146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:31.227325 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:31.270884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:31.271320 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:31.281197 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:31.283869 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:31.465715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:31.492189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:31.498769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:31.504630 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f6d67ccd-d4ee-4e9f-a61a-37164b446d5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.807324 Jul 26 05:00:31.507338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 32/49] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:30 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:31.730958 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:31.732171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:31.753305 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:31.760268 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:31.761373 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:31.768297 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:32.021025 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:32.087204 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2587aab9-56e2-4586-899a-19b40c401faa tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1294 microversion: 2.1 time: 0.881047 Jul 26 05:00:32.100219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 18/50] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:31 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1294 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:32.157532 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:32.169747 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-df1c658d-c7a5-4e9d-ad24-3101e51a1dac tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1273 microversion: 2.1 time: 0.451519 Jul 26 05:00:32.188359 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 33/51] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:31 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1273 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:32.222164 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2010866104", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:32.437196 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] validate_networks() for [('94dd837e-81c9-4e2e-9135-742712cb9531', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:00:32.531953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:32.532660 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:32.555827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:32.555827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:32.555827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:32.580355 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:33.425645 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:33.469940 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:33.494704 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:33.497265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-39ede960-d1b2-45a1-ae1f-05ab957d3439 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.969985 Jul 26 05:00:33.542971 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 34/52] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:32 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:33.593394 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:33.597025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:33.633057 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=4 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:33.649658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:33.665035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:33.667803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:33.671036 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:34.568014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:34.590939 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-787967d4-9ea2-4e4d-9b48-4d91c476ccbb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 1.041919 Jul 26 05:00:34.593034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 35/53] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:33 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:34.612081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:34.619523 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:34.658138 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:34.658619 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:34.666926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:34.669637 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:36.459103 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=18 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:36.601271 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:00:36.602203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:00:36.602674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:00:36.603258 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:00:36.604159 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:00:36.606523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:36.645211 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=29 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:36.665511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:36.668352 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:36.672106 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:36.677377 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:36.848722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:36.864641 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for project 1c772e5c90114978ad92818d58ca11c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:00:36.890678 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6660ba49-e613-4bd4-9ddc-c6323144169d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 2.286707 Jul 26 05:00:36.893515 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for user f0cc1af7d7d642889a1a11103f087e79 and project 1c772e5c90114978ad92818d58ca11c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:00:36.911979 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 36/54] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:34 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:36.941890 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:00:36.959116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:00:36.969700 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:36.971495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:36.988075 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:36.989570 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:36.992355 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:36.993458 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:37.155334 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-45f874f1-6d3c-43e5-ad07-dc6ab5eb1114 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.939004 Jul 26 05:00:37.156403 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 19/55] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:00:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 4942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:00:37.174197 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:37.175839 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:37.190952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:37.191817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:37.192868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:37.194102 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:37.727415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:37.773185 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:37.795356 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:37.803961 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-02e9b523-2d32-47c8-b808-f030eccb2b7d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.889492 Jul 26 05:00:37.806233 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 37/56] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:36 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:37.860833 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6e4b52b1-274b-4677-9e73-a7c307489423 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:37.878538 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6e4b52b1-274b-4677-9e73-a7c307489423 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:38.267088 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6e4b52b1-274b-4677-9e73-a7c307489423 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:38.309324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6e4b52b1-274b-4677-9e73-a7c307489423 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1222 microversion: 2.1 time: 0.491739 Jul 26 05:00:38.310728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 38/57] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:37 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1222 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:38.381197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:38.387599 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:38.431406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:38.436888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:38.456588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:38.457295 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:39.020766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:39.036957 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d476b26d-104e-405c-b478-fa469fa3bffd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 1.877555 Jul 26 05:00:39.041803 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 20/58] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:37 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:39.104383 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:39.107271 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:39.162471 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:39.165988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:39.170671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:39.176935 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:39.620590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:39.647418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:39.655307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:39.666214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a4b5f6b5-31fd-4faf-ade6-d038318f5624 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.588237 Jul 26 05:00:39.669588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 21/59] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:39 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:39.690429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:39.694399 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:39.733732 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:39.734409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:39.735504 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:39.740320 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:40.304220 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:40.317287 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d01d4de1-63bf-4240-b504-ca15ad4a8e13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1218 microversion: 2.1 time: 0.644017 Jul 26 05:00:40.320343 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 22/60] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:39 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1218 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:40.334056 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:40.346866 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:40.375488 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:40.379432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:40.381845 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:40.393298 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:40.583869 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:40.611615 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:40.626184 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2f7cc0d3-e030-4e48-8d13-abd9d42120e1 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 2.302873 Jul 26 05:00:40.634691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 39/61] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:38 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 2314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:40.707122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:40.713831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:40.751722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:40.755369 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:40.756640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:40.757295 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.198729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:41.229147 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fe30898f-2177-495d-9208-73848ae9fb20 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.907250 Jul 26 05:00:41.230874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 23/62] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:40 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:41.360587 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:41.372636 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:41.415389 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.418090 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.420109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.420656 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.651136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:41.675290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:41.686705 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:41.687953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8dab7013-156f-49f2-94b7-6a859b2544be tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.994492 Jul 26 05:00:41.688527 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 40/63] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:40 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:41.827938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-ba7521fa-1736-415c-a579-6d2491a15414 req-09f22e3b-c273-495d-af9c-2e467c684fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b3bcc1-fe56-4edd-b25a-a2c338610939", "tag": "a540d166-7fe8-4084-911e-a2037b5f9fd5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:41.835824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:41.858374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3b97222b-a7fc-4df9-af99-198ff578438e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1282 microversion: 2.1 time: 0.512253 Jul 26 05:00:41.859463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 24/64] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:41 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1282 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:41.860089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ba7521fa-1736-415c-a579-6d2491a15414 req-09f22e3b-c273-495d-af9c-2e467c684fa1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.860671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ba7521fa-1736-415c-a579-6d2491a15414 req-09f22e3b-c273-495d-af9c-2e467c684fa1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.867138 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:41.868435 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:41.876427 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.877623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.880573 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.881430 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.905887 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-ba7521fa-1736-415c-a579-6d2491a15414 req-09f22e3b-c273-495d-af9c-2e467c684fa1 service nova] Creating event network-changed:a540d166-7fe8-4084-911e-a2037b5f9fd5 for instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 on hv-cinder-85057 Jul 26 05:00:41.906461 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ba7521fa-1736-415c-a579-6d2491a15414 req-09f22e3b-c273-495d-af9c-2e467c684fa1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 05:00:41.918216 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80f26216-e48f-4577-ac7c-062358c8556c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.920039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80f26216-e48f-4577-ac7c-062358c8556c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.921166 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80f26216-e48f-4577-ac7c-062358c8556c None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:41.922274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80f26216-e48f-4577-ac7c-062358c8556c None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:41.937117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.compute.rpcapi [None req-80f26216-e48f-4577-ac7c-062358c8556c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 05:00:41.940283 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80f26216-e48f-4577-ac7c-062358c8556c None None] Releasing lock "compute-rpcapi-router" {{(pid=117994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 05:00:41.988024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-80f26216-e48f-4577-ac7c-062358c8556c None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297204 Jul 26 05:00:41.990799 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 41/65] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:42.270159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:42.270954 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:42.285146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:42.287419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:42.289253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:42.290749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:42.532070 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:42.548146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-50129b2d-bb71-4993-9eac-03cc9aa59c1e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.686317 Jul 26 05:00:42.560059 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 25/66] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:41 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:42.719414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:42.720994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:42.730361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:42.731914 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:42.733084 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:42.733752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:43.477350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:43.493528 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c8ef67e8-2900-4695-a8c5-7549c7cdd58b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 1.230205 Jul 26 05:00:43.494160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 42/67] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:42 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:43.499107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:43.514024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:43.532251 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:43.534204 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:43.534770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:43.535701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:43.536137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.030089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:44.059206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-591f8b55-c9f5-4f5d-b726-d88c8cf32e36 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1280 microversion: 2.1 time: 0.561533 Jul 26 05:00:44.063789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 43/68] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:43 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1280 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:44.080525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:44.084789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:44.119228 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.122979 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.129598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.132245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.519593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:44.541228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:44.544362 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:44.549619 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9f69185f-6b58-424e-b717-6b705a26fa40 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 1.834771 Jul 26 05:00:44.571888 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 26/69] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:42 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:44.582134 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-4184638b-37d3-41f4-b951-2631fe4ee7a4 req-e7362727-d63a-491d-8b13-1a76c1cc4701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3", "tag": "358a3c7b-6b7d-446a-adf5-98c0f873899c"}, {"name": "network-changed", "server_uuid": "c8aaf576-9983-4dfb-b436-2bb04e2deddc", "tag": "5ac2aa1d-8120-41dd-8ac5-91308f607903"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:44.600594 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-4184638b-37d3-41f4-b951-2631fe4ee7a4 req-e7362727-d63a-491d-8b13-1a76c1cc4701 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.601345 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-4184638b-37d3-41f4-b951-2631fe4ee7a4 req-e7362727-d63a-491d-8b13-1a76c1cc4701 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.626157 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-4184638b-37d3-41f4-b951-2631fe4ee7a4 req-e7362727-d63a-491d-8b13-1a76c1cc4701 service nova] Creating event network-changed:358a3c7b-6b7d-446a-adf5-98c0f873899c for instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 on hv-cinder-85057 Jul 26 05:00:44.626939 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-4184638b-37d3-41f4-b951-2631fe4ee7a4 req-e7362727-d63a-491d-8b13-1a76c1cc4701 service nova] Creating event network-changed:5ac2aa1d-8120-41dd-8ac5-91308f607903 for instance c8aaf576-9983-4dfb-b436-2bb04e2deddc on hv-cinder-85057 Jul 26 05:00:44.627674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-4184638b-37d3-41f4-b951-2631fe4ee7a4 req-e7362727-d63a-491d-8b13-1a76c1cc4701 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 05:00:44.629664 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce2ae11f-4c2c-4d40-b737-7933197c6084 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.630726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce2ae11f-4c2c-4d40-b737-7933197c6084 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.631906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce2ae11f-4c2c-4d40-b737-7933197c6084 None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.632558 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce2ae11f-4c2c-4d40-b737-7933197c6084 None None] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.643542 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.compute.rpcapi [None req-ce2ae11f-4c2c-4d40-b737-7933197c6084 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 05:00:44.645085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce2ae11f-4c2c-4d40-b737-7933197c6084 None None] Releasing lock "compute-rpcapi-router" {{(pid=117993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 05:00:44.679948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ce2ae11f-4c2c-4d40-b737-7933197c6084 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105807 Jul 26 05:00:44.681278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 27/70] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:44.697024 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:44.697776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:44.713247 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.714291 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.720549 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:44.721200 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:44.789190 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:44.818043 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-597fc2b3-6adf-4e3a-945b-ea2e8050da7b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.750673 Jul 26 05:00:44.820868 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 44/71] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:44 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:45.033297 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:45.043868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d137d999-fb67-4194-8314-bcd5d0124041 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.359442 Jul 26 05:00:45.057186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 28/72] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:44 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:45.113850 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:45.115749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:45.128250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:45.129447 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:45.132321 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:45.133080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:45.582828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:45.586585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:45.602420 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:45.603336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:45.604483 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:45.605110 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:45.628936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:45.644799 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-30c79e63-c9cc-4776-afc4-86b9946ce68a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.541565 Jul 26 05:00:45.656162 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 45/73] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:45 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:45.869870 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:45.870722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:45.880825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:45.881280 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:45.883975 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:45.884481 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:46.113676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:46.128218 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:46.131301 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:46.133110 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0aa3fcac-078c-44f2-938d-f4c5e991350a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.561152 Jul 26 05:00:46.138514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 29/74] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:45 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:46.143992 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:46.147784 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:46.154493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:46.155282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:46.156304 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:46.156989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:46.342849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:46.355682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e3a8ac4c-51bc-4d13-a919-db14c4eb98e3 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.492811 Jul 26 05:00:46.356464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 46/75] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:45 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:46.484808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:46.492705 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-55165694-0141-466f-b9c2-463e5c66c0a4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.352744 Jul 26 05:00:46.493296 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 30/76] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:46 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:46.667436 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:46.668320 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:46.683178 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:46.689406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:46.695916 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:46.696843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.016260 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=5 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:47.124713 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:47.133708 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a994d67b-37b0-42a9-aa50-7b07c0e84bf1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.470979 Jul 26 05:00:47.134589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 47/77] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:46 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:47.175124 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:47.176429 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:47.188415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.189120 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.190216 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.190925 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.348710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-8940c72b-d9e2-4194-a019-5050486b39c8 req-2e69d717-b697-4d37-9d0f-f720bcb20242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f4c17ac-a751-4ebc-9a68-b051d32dc63f", "tag": "ad83218c-f197-497a-8169-9fcae83efaee"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:47.374790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8940c72b-d9e2-4194-a019-5050486b39c8 req-2e69d717-b697-4d37-9d0f-f720bcb20242 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.375978 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8940c72b-d9e2-4194-a019-5050486b39c8 req-2e69d717-b697-4d37-9d0f-f720bcb20242 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.408844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-8940c72b-d9e2-4194-a019-5050486b39c8 req-2e69d717-b697-4d37-9d0f-f720bcb20242 service nova] Creating event network-changed:ad83218c-f197-497a-8169-9fcae83efaee for instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f on hv-cinder-85057 Jul 26 05:00:47.417054 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-8940c72b-d9e2-4194-a019-5050486b39c8 req-2e69d717-b697-4d37-9d0f-f720bcb20242 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405319 Jul 26 05:00:47.418421 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 31/78] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:00:47.425107 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:47.426248 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:47.434377 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.435246 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.436267 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.436681 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:47.437068 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.448126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:47.449667 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:47.451809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-95835b69-c417-4b3f-ba9e-488fff24bbc6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.288464 Jul 26 05:00:47.453968 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 48/79] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:47 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:47.519435 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:47.519435 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:47.524564 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.528228 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.529115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:47.529562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:47.688765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:47.706182 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1311dbdb-d0b9-4d40-819b-39ff2bbf60fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.286268 Jul 26 05:00:47.706886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 32/80] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:47 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:47.791180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:47.810340 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-36e1784e-c1cc-4ede-a04f-31d4e69002cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.298125 Jul 26 05:00:47.812846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 49/81] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:47 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:48.164853 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:48.165473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:48.180426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:48.180923 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:48.181739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:48.182176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:48.479688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:48.480827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:48.484665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:48.503157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:48.503681 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:48.504470 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:48.504906 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:48.686394 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:48.699856 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2bc0ba69-ceb1-47e5-b184-ecf81710c287 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.538900 Jul 26 05:00:48.700860 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 33/82] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:48 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:48.729197 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:48.730056 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:48.752727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:48.753177 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:48.754040 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:48.754475 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:49.040099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:49.053990 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:49.058889 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:49.060145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-927974ab-c05e-4e60-93e6-ef6652b21c67 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.585514 Jul 26 05:00:49.060715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 50/83] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:48 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:00:49.077299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:49.078193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:49.090359 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:49.090803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:49.092456 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:49.094759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:49.112956 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:49.126251 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-25286727-dbc6-4a9c-954f-74877ab3d34d tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.402066 Jul 26 05:00:49.128707 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 34/84] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:48 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:49.723263 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:49.724885 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:49.736156 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:49.740049 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:49.741357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:49.744126 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:49.789269 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:50.383612 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:50.415374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-71bf93a5-2efe-4bdf-b162-b5ba1bdf521f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 1.336898 Jul 26 05:00:50.417624 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 51/85] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:49 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:50.426289 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:50.427319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:50.453581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:50.455175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:50.458059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:50.459181 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:50.691979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:50.701690 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-71772d1f-4ef0-4f34-94a0-2d55cf75a5da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.982687 Jul 26 05:00:50.711954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 35/86] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:49 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:50.719082 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:50.719726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:50.744496 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:50.746066 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:50.749067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:50.750053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:50.802574 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:50.815435 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:50.821272 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:50.824618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16529703-8774-41ef-9a50-0b44899b070e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.401870 Jul 26 05:00:50.826549 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 52/87] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:50 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:51.191848 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:51.205658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ae44bb4c-eefd-47fb-85a8-d29c56e280ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.491359 Jul 26 05:00:51.206374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 36/88] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:50 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:51.380448 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-623b3bca-e595-48f0-aaa6-59d43dd78a1a req-ef307c9b-4170-47f5-90fa-60c509f03926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b20933-1aa3-4f28-9d7b-2482564c6c03", "tag": "b559b234-be1a-4b1e-9174-8e074a42caaf"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:51.411819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-623b3bca-e595-48f0-aaa6-59d43dd78a1a req-ef307c9b-4170-47f5-90fa-60c509f03926 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:51.412373 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-623b3bca-e595-48f0-aaa6-59d43dd78a1a req-ef307c9b-4170-47f5-90fa-60c509f03926 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:51.445033 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:51.446362 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:51.457998 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-623b3bca-e595-48f0-aaa6-59d43dd78a1a req-ef307c9b-4170-47f5-90fa-60c509f03926 service nova] Creating event network-changed:b559b234-be1a-4b1e-9174-8e074a42caaf for instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 on hv-cinder-85057 Jul 26 05:00:51.462862 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:51.469587 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:51.472810 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:51.473492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:51.475346 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-623b3bca-e595-48f0-aaa6-59d43dd78a1a req-ef307c9b-4170-47f5-90fa-60c509f03926 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108267 Jul 26 05:00:51.487452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 53/89] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:51.739290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:51.740594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:51.750825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:51.751521 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:51.752579 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:51.753260 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:51.885200 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:51.895936 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-97e336ce-a72b-41b5-a5eb-82244971725c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.459256 Jul 26 05:00:51.897191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 37/90] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:51 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:51.912999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:51.913738 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:51.922357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:51.923192 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:51.924335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:51.925288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:51.933664 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:52.147590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:52.157079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-946c8e9d-cea9-4baa-a6c2-c6b85a899af3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.426177 Jul 26 05:00:52.163041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 54/91] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:51 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:52.229434 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:52.230294 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:52.238014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:52.238496 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:52.242059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:52.242059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:52.255737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:52.268561 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:52.270186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:52.273244 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8f7c30c8-2f42-42e7-b808-b0ab77a67704 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.374544 Jul 26 05:00:52.291494 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 38/92] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:51 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:52.564758 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:52.583329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-217f6fbd-bfd5-4a62-958e-5a4faf9f4083 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.357709 Jul 26 05:00:52.588695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 55/93] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:52 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:52.918603 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:52.919356 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:52.926057 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:52.926700 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:52.927630 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:52.928192 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.092812 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:53.100279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7677bc09-e94c-4700-b711-085d57345138 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.185554 Jul 26 05:00:53.101621 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 39/94] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:52 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:53.178462 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:53.179075 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:53.185927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.186351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.187139 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.187577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.296015 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:53.296642 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:53.304865 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.305319 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.306098 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.306520 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.367759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:53.375357 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-49f23327-b003-43b1-b68e-84523a696ee7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.200755 Jul 26 05:00:53.376292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 56/95] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:53 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:53.530610 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:53.541591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:53.543515 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:53.545203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ba170aec-3d14-4a8a-957b-4396af60778d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.252991 Jul 26 05:00:53.545919 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 40/96] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:53 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:53.612279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:53.614336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:53.623058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.624312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.625545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:53.626434 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:53.647265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:53.822395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:53.833622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-382f838a-223a-40b7-ae15-5600ba85321b tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.225366 Jul 26 05:00:53.834587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 57/97] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:53 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:54.123245 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:54.124530 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:54.131690 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.132600 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.133654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.134294 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.289529 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:54.297220 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-31e71591-2a91-41c7-9c0a-ab25a449712c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.178860 Jul 26 05:00:54.297930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 41/98] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:54 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:54.396711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:54.397338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:54.403817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.404287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.405079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.405490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.547808 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:54.556334 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-08d1b588-8ba2-47e6-a185-4bb5f39ecd9d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.163555 Jul 26 05:00:54.557143 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 58/99] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:54 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:54.569124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:54.569843 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:54.576726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.577241 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.578069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.578548 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.643074 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=8 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:54.718392 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:54.727259 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:54.728807 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:54.729921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-af0a9b67-f87a-4439-836c-c7cc83fc86d9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.165001 Jul 26 05:00:54.730474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 42/100] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:54 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:54.855523 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:54.856098 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:54.864285 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.864723 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:54.865610 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:54.865998 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.008823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:55.020180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b3a3f7c8-4869-45c2-a898-c5cfbe4ca690 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.168411 Jul 26 05:00:55.021122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 59/101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:54 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:55.318507 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:55.319158 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:55.325679 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:55.326472 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.327431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:55.327902 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.491310 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:55.500810 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-39f00d42-ea44-4622-a290-669730300282 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.186105 Jul 26 05:00:55.501769 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 43/102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:55 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:55.578845 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:55.579452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:55.587171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:55.587638 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.588400 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:55.588832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.727078 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:55.735182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f53e6a2f-fcf1-4239-9f5c-360b21b00d88 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.160613 Jul 26 05:00:55.735809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 60/103] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:55 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:55.752685 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:55.753286 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:55.760196 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:55.760654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.761405 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:55.761832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:55.907027 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:55.917824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:55.920008 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:55.921230 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b9f06514-fc7f-4110-ad96-d8c6460dc514 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.172597 Jul 26 05:00:55.921995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 44/104] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:55 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:56.045812 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:56.046431 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:56.053188 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.053996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.054829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.055525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.221698 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:56.230969 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-76622391-60ec-4ab6-a550-2fcd23d77c50 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.188853 Jul 26 05:00:56.231830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 61/105] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:56 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:56.528992 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:56.531000 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:56.544818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.547607 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.548563 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.552183 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.555423 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-6771edaa-2414-4992-bd07-b69805bc8fa8 req-77f49ea8-9cc7-47ba-ac30-d022461a4020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aaf576-9983-4dfb-b436-2bb04e2deddc", "name": "network-vif-plugged", "status": "completed", "tag": "5ac2aa1d-8120-41dd-8ac5-91308f607903"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:56.566892 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6771edaa-2414-4992-bd07-b69805bc8fa8 req-77f49ea8-9cc7-47ba-ac30-d022461a4020 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.567355 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6771edaa-2414-4992-bd07-b69805bc8fa8 req-77f49ea8-9cc7-47ba-ac30-d022461a4020 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.581403 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-6771edaa-2414-4992-bd07-b69805bc8fa8 req-77f49ea8-9cc7-47ba-ac30-d022461a4020 service nova] Creating event network-vif-plugged:5ac2aa1d-8120-41dd-8ac5-91308f607903 for instance c8aaf576-9983-4dfb-b436-2bb04e2deddc on hv-cinder-85057 Jul 26 05:00:56.587251 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-6771edaa-2414-4992-bd07-b69805bc8fa8 req-77f49ea8-9cc7-47ba-ac30-d022461a4020 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167669 Jul 26 05:00:56.588537 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 45/106] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:00:56.764723 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:56.774161 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:56.783767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.785044 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.786296 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.787189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.857035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:56.870132 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f77417ee-4eaf-411d-b7b7-7ba803254182 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.345387 Jul 26 05:00:56.875313 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 62/107] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:56 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:56.955998 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:56.956885 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:56.966261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.966718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:56.969715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:56.970160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:57.066466 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:57.074925 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-80b74aba-cde1-42ee-9092-9f4d9d493f4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.316913 Jul 26 05:00:57.076269 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 46/108] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:56 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:57.155635 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:57.167157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:57.168987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:57.170113 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0ffafafc-fa96-4f3c-99a3-e869378d5c2c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.229939 Jul 26 05:00:57.170669 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 63/109] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:56 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:00:57.251742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:57.252347 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:57.258930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:57.259432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:57.260250 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:57.260906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:57.407896 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:57.415681 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d62c1b8b-f51f-4347-a6ba-27d4d9043521 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.167876 Jul 26 05:00:57.416273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 47/110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:57 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:57.896455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:57.897286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:57.906791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:57.907546 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:57.908546 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:57.909068 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.055295 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.067890 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-df325d86-e614-4c77-845e-bc6f892d9ad7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.177221 Jul 26 05:00:58.068872 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 64/111] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:57 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:58.098293 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:58.098900 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:58.105545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.105992 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.106756 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.107191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.193470 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:58.194052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:58.200347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.201138 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.201923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.202340 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.255611 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.263377 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1bae7ece-d46e-4347-8aee-dccc02ff565b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.169558 Jul 26 05:00:58.263988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 48/112] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:58 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:00:58.340693 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.353059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.355463 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.357208 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e54eaca8-50bd-4b62-afa0-e130dc1da38a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.167458 Jul 26 05:00:58.358035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 65/113] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:58 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:00:58.437828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:58.438463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:58.445145 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.445583 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.446333 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.446757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.590965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:58.601511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-44883840-0500-409b-b7ef-21d9e6a121c5 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.167490 Jul 26 05:00:58.603656 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 49/114] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:58 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:58.610732 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-ca714a49-dd2c-4123-a9e3-6e6a705c3838 req-3e7dbcf9-420a-4370-a567-4003d66415f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3", "name": "network-vif-plugged", "status": "completed", "tag": "358a3c7b-6b7d-446a-adf5-98c0f873899c"}, {"server_uuid": "02b3bcc1-fe56-4edd-b25a-a2c338610939", "name": "network-vif-plugged", "status": "completed", "tag": "a540d166-7fe8-4084-911e-a2037b5f9fd5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:00:58.622594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ca714a49-dd2c-4123-a9e3-6e6a705c3838 req-3e7dbcf9-420a-4370-a567-4003d66415f0 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:58.623042 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ca714a49-dd2c-4123-a9e3-6e6a705c3838 req-3e7dbcf9-420a-4370-a567-4003d66415f0 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:58.636424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-ca714a49-dd2c-4123-a9e3-6e6a705c3838 req-3e7dbcf9-420a-4370-a567-4003d66415f0 service nova] Creating event network-vif-plugged:358a3c7b-6b7d-446a-adf5-98c0f873899c for instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 on hv-cinder-85057 Jul 26 05:00:58.636924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-ca714a49-dd2c-4123-a9e3-6e6a705c3838 req-3e7dbcf9-420a-4370-a567-4003d66415f0 service nova] Creating event network-vif-plugged:a540d166-7fe8-4084-911e-a2037b5f9fd5 for instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 on hv-cinder-85057 Jul 26 05:00:58.643590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-ca714a49-dd2c-4123-a9e3-6e6a705c3838 req-3e7dbcf9-420a-4370-a567-4003d66415f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037878 Jul 26 05:00:58.644224 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 66/115] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:00:59.094361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:59.095095 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:59.111786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.111786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.111786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.111786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.241506 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.253716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-29dc2090-7d3e-4dbf-99b0-9d4b10fc0aed tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.163316 Jul 26 05:00:59.254573 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 50/116] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:59 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:59.288261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:59.288918 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:59.295914 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.296358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.297118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.297552 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.381139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:59.381811 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:59.388354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.388771 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.389720 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.390154 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.443064 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.451129 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2e3af474-f8ee-4f7f-9412-b0a11a42ffda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.168454 Jul 26 05:00:59.451925 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 67/117] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:59 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:00:59.539226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.549109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.550622 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.551857 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-258debfd-b625-4f9d-bad0-1e9d6c1fbbfc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.175103 Jul 26 05:00:59.552383 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 51/118] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:00:59 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:00:59.622572 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:00:59.623175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:00:59.629779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.630218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.630971 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:00:59.631384 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:00:59.771596 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:00:59.779154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9c20d1c1-90e0-4e99-9df3-393faf6383ec tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.160465 Jul 26 05:00:59.779738 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 68/119] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:00:59 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:00.275473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:00.276156 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:00.283810 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.284241 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.285208 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.285520 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.421550 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:00.425113 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:00.430099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6600fe7c-9226-4599-ad6f-8ef5d975a7d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.158448 Jul 26 05:01:00.430758 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 52/120] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:00 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:00.473262 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:00.473894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:00.480756 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.481206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.481975 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.482408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.574787 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:00.575469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:00.582804 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.583341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.584243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.584758 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.660374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:00.668332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dc01e03a-f023-4b86-9445-84f36f636f99 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.199027 Jul 26 05:01:00.668976 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 69/121] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:00 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:00.726341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:00.734464 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:00.735995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:00.737102 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-922d70e1-ec18-4aa4-8832-128b80d5893a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.166416 Jul 26 05:01:00.737680 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 53/122] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:01:00 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:01:00.802237 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:00.803034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:00.811469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.812096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.813089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:00.813667 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:00.976223 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:00.984225 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d28e8249-683e-4fa4-a2af-782fddca5fc9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.187144 Jul 26 05:01:00.987720 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 70/123] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:00 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:01.457493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:01.458103 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:01.465914 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.466538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.467331 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.467796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.604138 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:01.612020 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-019da136-79b6-4dd0-9ca5-3d55fcf3c8e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.158824 Jul 26 05:01:01.612613 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 54/124] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:01 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:01.690994 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:01.691753 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:01.699278 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.699867 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.700629 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.701420 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.759850 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:01.760459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:01.767228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.767672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.768651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:01.769075 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:01.885293 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:01.893411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d54a16b9-f3cd-4b4f-92b4-4f3fb2472506 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.207654 Jul 26 05:01:01.893989 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 71/125] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:01 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:01.931698 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:01.943265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:01.945562 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:01.947326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2fb4da7e-11cc-4c94-8272-66b537a817e1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.191411 Jul 26 05:01:01.948264 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 55/126] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:01:01 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:01:02.008456 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:02.009146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:02.017811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.018516 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.019745 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.020359 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.164422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:02.172507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-076b6912-93f9-436c-aafb-6bd518d08438 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.170048 Jul 26 05:01:02.173073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 72/127] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:02 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:02.633674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:02.634291 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:02.641136 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.641581 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.642361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.642824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.798687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:02.806327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4cb780c1-8049-4c8f-b372-a4bd710ec8a6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.176846 Jul 26 05:01:02.806946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 56/128] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:02 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:02.925821 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:02.926619 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:02.933080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.933520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.934290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.934712 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.980178 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:02.980885 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:02.987516 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.988006 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:02.988783 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:02.989208 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:03.238909 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:03.247064 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0574ebaf-3e55-41b1-90f9-01bafea9a1e0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.325376 Jul 26 05:01:03.247702 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 73/129] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:02 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:03.255994 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-27298508-ce96-48c4-8379-1a2fb1f7ba08 req-7eaf8f2c-9c19-4b58-baee-5b6409ca0b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4c17ac-a751-4ebc-9a68-b051d32dc63f", "name": "network-vif-plugged", "status": "completed", "tag": "ad83218c-f197-497a-8169-9fcae83efaee"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:03.267784 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:03.267981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-27298508-ce96-48c4-8379-1a2fb1f7ba08 req-7eaf8f2c-9c19-4b58-baee-5b6409ca0b0f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:03.268333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-27298508-ce96-48c4-8379-1a2fb1f7ba08 req-7eaf8f2c-9c19-4b58-baee-5b6409ca0b0f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:03.277466 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:03.278999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:03.280334 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b3e6d02e-9288-4e38-a9c8-b6518c8c221a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.308158 Jul 26 05:01:03.280495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-27298508-ce96-48c4-8379-1a2fb1f7ba08 req-7eaf8f2c-9c19-4b58-baee-5b6409ca0b0f service nova] Creating event network-vif-plugged:ad83218c-f197-497a-8169-9fcae83efaee for instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f on hv-cinder-85057 Jul 26 05:01:03.282288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 57/130] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:01:02 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:01:03.287419 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:03.289074 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:03.290164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-27298508-ce96-48c4-8379-1a2fb1f7ba08 req-7eaf8f2c-9c19-4b58-baee-5b6409ca0b0f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041241 Jul 26 05:01:03.291186 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 74/131] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:03.297206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:03.297693 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:03.298560 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:03.299020 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:03.436011 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:03.444031 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-73d23f6b-206c-45d3-b4a8-2731909f6286 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.160421 Jul 26 05:01:03.444548 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 58/132] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:03 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:03.828435 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:03.829175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:03.836727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:03.837248 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:03.838039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:03.838471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:03.858388 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:03.994992 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:04.003478 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-587d9473-5d31-448a-846a-e94efa7200e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.179619 Jul 26 05:01:04.004107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 75/133] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:03 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:04.269137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:04.269800 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:04.276319 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.276765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.277532 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.277956 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.308293 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:04.308895 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:04.315355 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.315824 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.316590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.317012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.505970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:04.514347 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-da054b91-4098-4f07-a443-f29b29877906 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.249210 Jul 26 05:01:04.515085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 59/134] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:04 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:04.520435 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:04.521034 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:04.528279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.529181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.530229 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:04.530884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:04.536165 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:04.544928 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:04.546817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:04.548404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a58cbb47-934e-4f68-9125-0e125a535f02 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.243562 Jul 26 05:01:04.554292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 76/135] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:01:04 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:01:04.860806 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:04.868964 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4e1f3663-19ca-48c7-9b80-429b4e884bbf tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.352809 Jul 26 05:01:04.869546 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 60/136] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:04 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:05.027987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:05.028746 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:05.035303 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.035789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.036556 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.037005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.177004 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:05.185744 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-48e7d711-bc3d-45b1-ac33-2c21b30ed941 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.163842 Jul 26 05:01:05.186341 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 77/137] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:05 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:05.538579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:05.539221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:05.547181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.548004 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.549337 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.550067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.572506 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:05.573114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:05.580215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.580662 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.581434 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.581862 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.817579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:05.821452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:05.827479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f87d98b5-4a21-46f4-a05d-d82f3ae66214 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.293034 Jul 26 05:01:05.828112 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 61/138] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:05 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:05.836656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:05.836656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:05.836656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4bbe6eec-f500-4707-9183-1835ee5b8c8c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.267043 Jul 26 05:01:05.837067 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 78/139] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:01:05 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:01:05.891028 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:05.891704 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:05.899031 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.899362 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:05.900182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:05.900610 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.055799 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:06.069796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2226bb40-292c-49a2-bd0a-bb98bd3925fb tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.182420 Jul 26 05:01:06.070746 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 79/140] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:05 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:06.208024 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:06.208715 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:06.216236 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.216917 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.217678 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.218203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.436950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:06.445394 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-34ecf7af-29af-4162-96c2-7f4052b9419a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.241473 Jul 26 05:01:06.460399 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 62/141] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:06 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:06.849323 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:06.849941 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:06.862643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:06.863947 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:06.864507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.866575 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.869194 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.869371 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:06.870859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.877420 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.881065 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:06.882876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:06.883767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:07.174653 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.188636 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f1baf71a-e743-4812-aa35-b928064eb057 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.342628 Jul 26 05:01:07.189258 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 80/142] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:06 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:07.195440 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:07.197040 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:07.204715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:07.205618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:07.205763 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.206718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:07.207336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:07.222726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.224800 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.226000 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7d291d15-122c-4673-9bce-1b57b22751b4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1407 microversion: 2.20 time: 0.370670 Jul 26 05:01:07.227767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 63/143] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:01:06 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:01:07.469983 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:07.470523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:07.494435 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:07.495046 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:07.495674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:07.496103 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:07.580197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.592149 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0e7e5521-ced1-425b-a575-78c005c21df9 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1315 microversion: 2.1 time: 0.401275 Jul 26 05:01:07.599484 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 81/144] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:07 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:07.613949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-288d874f-f0b2-4130-941d-bcb377180054 req-097c6c2a-d972-4997-b608-bc3c8eceba0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b20933-1aa3-4f28-9d7b-2482564c6c03", "name": "network-vif-plugged", "status": "completed", "tag": "b559b234-be1a-4b1e-9174-8e074a42caaf"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:07.653840 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-288d874f-f0b2-4130-941d-bcb377180054 req-097c6c2a-d972-4997-b608-bc3c8eceba0a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:07.654625 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-288d874f-f0b2-4130-941d-bcb377180054 req-097c6c2a-d972-4997-b608-bc3c8eceba0a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:07.693750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-288d874f-f0b2-4130-941d-bcb377180054 req-097c6c2a-d972-4997-b608-bc3c8eceba0a service nova] Creating event network-vif-plugged:b559b234-be1a-4b1e-9174-8e074a42caaf for instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 on hv-cinder-85057 Jul 26 05:01:07.699168 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-288d874f-f0b2-4130-941d-bcb377180054 req-097c6c2a-d972-4997-b608-bc3c8eceba0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097890 Jul 26 05:01:07.700383 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 82/145] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:07.772997 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:07.781920 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8b2c8aa2-92b9-425b-bf91-8b495015f9ab tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.317079 Jul 26 05:01:07.797506 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 64/146] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:07 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:08.220123 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:08.221868 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:08.235170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.235923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.237096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.237658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.256685 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:08.257613 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:08.284469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.284469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.284469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.284469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.470073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:08.481146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c32d7d8a-e9ea-48af-8f7c-04a3ee403e56 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.273291 Jul 26 05:01:08.495688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 83/147] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:08 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:08.499302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:08.508962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:08.510533 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:08.511769 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-de214705-b0d0-4c78-892e-6540bf4051b0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1597 microversion: 2.20 time: 0.264428 Jul 26 05:01:08.523881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 65/148] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:01:08 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1597 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:01:08.535956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a628536f-733a-4b75-bfe2-b83443e33731 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:08.536420 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a628536f-733a-4b75-bfe2-b83443e33731 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:08.544754 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a628536f-733a-4b75-bfe2-b83443e33731 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.545760 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a628536f-733a-4b75-bfe2-b83443e33731 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.546841 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a628536f-733a-4b75-bfe2-b83443e33731 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.547924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a628536f-733a-4b75-bfe2-b83443e33731 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.619605 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:08.620798 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:08.634442 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.635496 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.636725 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.638416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.725767 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a628536f-733a-4b75-bfe2-b83443e33731 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194025 Jul 26 05:01:08.726213 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 84/149] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Jul 26 05:01:08 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:01:08.807413 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:08.808267 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:08.817538 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.818584 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.819587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:08.820938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:08.838294 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:08.850248 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1d1c0fdb-b8ef-4f5b-979c-17ff7c357f8f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1501 microversion: 2.1 time: 0.238918 Jul 26 05:01:08.851123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 66/150] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:08 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:09.008618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:09.019538 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-54c32041-313f-486f-83eb-ab94d619d4c2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.218392 Jul 26 05:01:09.032898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 85/151] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:08 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:09.504075 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:09.505411 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:09.512581 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:09.513022 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:09.513849 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:09.514256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:09.716751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:09.728056 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dc194c46-f28a-4503-a99a-e47b7273c929 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.228192 Jul 26 05:01:09.728852 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 67/152] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:09 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:10.049013 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:10.050454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:10.059032 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:10.059590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:10.060599 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:10.061115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:10.230643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:10.241825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-eb1f43b2-358b-41ae-aae7-658dfa8c5a9e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.201152 Jul 26 05:01:10.255239 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 86/153] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:10 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:10.531500 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-c855c29f-b306-40bb-be54-a9e229ce6cad req-4a02dd5f-b912-41bf-8397-0a5d530b4e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b3bcc1-fe56-4edd-b25a-a2c338610939", "tag": "a540d166-7fe8-4084-911e-a2037b5f9fd5"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:10.543808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-c855c29f-b306-40bb-be54-a9e229ce6cad req-4a02dd5f-b912-41bf-8397-0a5d530b4e88 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:10.544425 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-c855c29f-b306-40bb-be54-a9e229ce6cad req-4a02dd5f-b912-41bf-8397-0a5d530b4e88 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:10.557731 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-c855c29f-b306-40bb-be54-a9e229ce6cad req-4a02dd5f-b912-41bf-8397-0a5d530b4e88 service nova] Creating event network-changed:a540d166-7fe8-4084-911e-a2037b5f9fd5 for instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 on hv-cinder-85057 Jul 26 05:01:10.565202 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-c855c29f-b306-40bb-be54-a9e229ce6cad req-4a02dd5f-b912-41bf-8397-0a5d530b4e88 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040526 Jul 26 05:01:10.565898 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 68/154] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:10.753053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:10.754045 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:10.764439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:10.765006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:10.769537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:10.770741 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:10.984763 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:10.993673 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-978eb296-e798-4356-b9b1-921791df28d9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.247629 Jul 26 05:01:10.994260 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 87/155] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:10 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:11.264452 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:11.265487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:11.273206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:11.273917 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:11.275000 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:11.275653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:11.563640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:11.581651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-efa651f8-35b5-4307-bef7-586cfade04f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1362 microversion: 2.1 time: 0.321623 Jul 26 05:01:11.583910 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 69/156] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:11 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:12.043822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:12.046029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:12.068298 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:12.069294 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:12.070773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:12.071713 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:12.366913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:12.375718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c61ec8ff-b6dc-4335-9242-87070fe15701 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.347897 Jul 26 05:01:12.376310 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 88/157] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:12 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:12.601832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f4ddfa83-4c84-49ca-ab65-a5c2d309a257 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "310089d3-4b88-4bc2-b80c-0511bfdc9e59"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:12.607448 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f4ddfa83-4c84-49ca-ab65-a5c2d309a257 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:12.610399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:12.611771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:12.621771 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4ddfa83-4c84-49ca-ab65-a5c2d309a257 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:12.623195 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4ddfa83-4c84-49ca-ab65-a5c2d309a257 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:12.624454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:12.625191 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:12.625461 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4ddfa83-4c84-49ca-ab65-a5c2d309a257 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:12.626929 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:12.627710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4ddfa83-4c84-49ca-ab65-a5c2d309a257 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:12.627884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:12.703657 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:13.003161 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:13.018131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-254b8369-8204-449a-981f-38ac397a2902 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1548 microversion: 2.1 time: 0.412155 Jul 26 05:01:13.018639 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 89/158] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:12 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1548 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:13.057601 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e6ae905e-78e9-4fe0-835a-7c56c3c8e056 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:13.058477 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e6ae905e-78e9-4fe0-835a-7c56c3c8e056 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:13.065790 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6ae905e-78e9-4fe0-835a-7c56c3c8e056 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:13.066234 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6ae905e-78e9-4fe0-835a-7c56c3c8e056 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:13.067029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6ae905e-78e9-4fe0-835a-7c56c3c8e056 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:13.067764 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6ae905e-78e9-4fe0-835a-7c56c3c8e056 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:13.172302 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e6ae905e-78e9-4fe0-835a-7c56c3c8e056 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119063 Jul 26 05:01:13.172894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 90/159] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:01:13 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:13.407399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:13.408277 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:13.421629 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:13.422403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:13.424200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:13.427265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:13.628351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:13.637518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0a2bf1f0-514e-4ca7-bc66-c1714a82ca32 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.235072 Jul 26 05:01:13.638238 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 91/160] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:13 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:14.245256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-ebd36d0b-286d-47ae-a31a-82027f9a39ce req-28466ebb-83bf-466e-a4bf-851d618048ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3", "tag": "358a3c7b-6b7d-446a-adf5-98c0f873899c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:14.250569 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=98 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:14.258264 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ebd36d0b-286d-47ae-a31a-82027f9a39ce req-28466ebb-83bf-466e-a4bf-851d618048ca service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:14.258708 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ebd36d0b-286d-47ae-a31a-82027f9a39ce req-28466ebb-83bf-466e-a4bf-851d618048ca service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:14.276719 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-ebd36d0b-286d-47ae-a31a-82027f9a39ce req-28466ebb-83bf-466e-a4bf-851d618048ca service nova] Creating event network-changed:358a3c7b-6b7d-446a-adf5-98c0f873899c for instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 on hv-cinder-85057 Jul 26 05:01:14.285146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-ebd36d0b-286d-47ae-a31a-82027f9a39ce req-28466ebb-83bf-466e-a4bf-851d618048ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043199 Jul 26 05:01:14.286139 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 92/161] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:14.661497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:14.663301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:14.671051 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:14.671608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:14.672467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:14.672968 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:14.819168 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:14.829345 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-28659df8-a069-4afa-9004-2e46fc9c5173 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.172150 Jul 26 05:01:14.830249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 93/162] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:14 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:15.850948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:15.851701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:15.858536 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:15.858985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:15.859807 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:15.860647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:15.866280 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:16.021331 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:16.035263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b95a8a36-4981-48cf-8730-1a63c2d2d682 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.187885 Jul 26 05:01:16.036303 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 94/163] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:15 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:16.454462 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f4ddfa83-4c84-49ca-ab65-a5c2d309a257 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "POST /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.856721 Jul 26 05:01:16.455817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 70/164] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:01:12 2022] POST /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc/os-volume_attachments => generated 194 bytes in 3859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:01:17.058545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:17.059311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:17.066309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:17.066750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:17.067676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:17.068111 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:17.220544 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:17.229014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c612cb1d-3c81-4502-bbcd-75580fcb1758 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.174524 Jul 26 05:01:17.229612 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 95/165] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:17 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:18.256780 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:18.257615 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:18.265174 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:18.265614 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:18.266400 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:18.266862 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:18.434984 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:18.443944 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-99f230c2-199e-4f32-856b-22f0c2d44751 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.191550 Jul 26 05:01:18.444558 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 71/166] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:18 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:19.466487 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:19.467186 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:19.474758 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:19.475203 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:19.476044 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:19.476500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:19.632590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:19.641242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e55178b9-d951-4b96-a50b-93ee56ad30b6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.178724 Jul 26 05:01:19.641985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 96/167] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:19 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:20.663962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:20.665004 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:20.672925 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:20.673470 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:20.674380 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:20.675090 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:20.843262 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:20.851652 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6220dbaf-b5e2-4755-bff8-354b7ef27e26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.192302 Jul 26 05:01:20.852235 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 72/168] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:20 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:21.874114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:21.874722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:21.881250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:21.881690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:21.882446 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:21.882906 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:22.046958 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:22.054809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1071e9e9-9bf4-4347-9251-585174abe65e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.184617 Jul 26 05:01:22.055353 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 97/169] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:21 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:23.077725 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:23.078561 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:23.097726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:23.098166 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:23.099080 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:23.099763 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:23.247286 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:23.256760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5353c40c-f078-4605-9392-3ba2aa8ca4dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.185218 Jul 26 05:01:23.257344 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 73/170] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:23 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:24.278174 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:24.278773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:24.285159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:24.285575 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:24.286592 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:24.287021 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:24.427217 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:24.435115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c72da061-2ef5-4ec1-a222-477a5642db10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.160784 Jul 26 05:01:24.435732 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 98/171] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:24 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:25.459012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:25.460210 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:25.469648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:25.470188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:25.471322 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:25.471802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:25.627243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:25.635485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-db84a3df-963a-41bb-8225-c54404b02b26 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.181682 Jul 26 05:01:25.636140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 74/172] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:25 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:26.661036 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:26.661736 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:26.669465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:26.669910 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:26.670690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:26.671121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:26.819731 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:26.828589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1c3037a0-14e0-4ecd-a4c6-d30717a31f8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1322 microversion: 2.1 time: 0.173328 Jul 26 05:01:26.829187 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 99/173] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:26 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:27.852442 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:27.853091 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:27.859378 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:27.860024 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:27.860933 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:27.861579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.008306 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:28.016854 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d5e7df5d-0f93-4d36-9114-aed556c3210a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1515 microversion: 2.1 time: 0.169210 Jul 26 05:01:28.017503 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 75/174] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:27 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:28.039501 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:28.042543 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:28.050701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.051153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.052108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.052537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.079573 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lazy-loading 'flavor' on Instance uuid c4b20933-1aa3-4f28-9d7b-2482564c6c03 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:01:28.218625 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4353a8d9-f5a7-44c8-8cc9-b8fd2ca0227c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03/action" status: 200 len: 32 microversion: 2.1 time: 0.183684 Jul 26 05:01:28.219283 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 100/175] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:01:28 2022] POST /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:01:28.231217 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:28.232129 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:28.238885 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.239696 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.240516 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:28.241591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:28.401858 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:28.411871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a0d1ffd8-25bf-4b28-81bc-5c90197b038b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.184612 Jul 26 05:01:28.412928 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 76/176] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:28 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:29.435520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:29.436324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:29.445970 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:29.446508 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:29.447688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:29.448334 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:29.588987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:29.597204 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b737b299-6eb2-497e-adb7-e46a936753d3 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.165912 Jul 26 05:01:29.597796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 101/177] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:29 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:30.624154 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:30.626645 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:30.636742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:30.637186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:30.637971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:30.638396 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:30.809331 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:30.817470 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9dde34c3-75dc-4bce-bf6a-f3b0b3950d7c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.200753 Jul 26 05:01:30.818066 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 77/178] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:30 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:31.845772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:31.849078 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:31.871351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:31.872085 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:31.886093 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:31.886571 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:32.079433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:32.106641 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-142fb882-f84a-451c-9eaa-6d5b51baf213 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.269451 Jul 26 05:01:32.107368 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 102/179] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:31 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:33.129440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:33.130124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:33.137336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.137860 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.138732 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:33.139162 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:33.299570 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:33.307958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5143a925-de0b-4ab0-978c-e4892fd2d8c4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.182726 Jul 26 05:01:33.313686 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 78/180] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:33 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:34.332809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:34.333575 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:34.341646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:34.342084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:34.342971 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:34.343581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:34.485930 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:34.495665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9a224ab6-940c-4285-ae13-1c447ec3fc13 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.169310 Jul 26 05:01:34.496431 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 103/181] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:34 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:35.521590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:35.522265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:35.529508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:35.529928 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.530687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:35.531105 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:35.674598 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:35.685840 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-47cbbcc2-3fad-4446-9b16-de7dbe6d2bb6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.169456 Jul 26 05:01:35.686852 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 79/182] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:35 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:36.722728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:36.724602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:36.735654 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.736352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.737332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:36.738050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:36.882497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:36.890717 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0804b56d-e1ab-4b49-8ecb-2690de925126 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.171916 Jul 26 05:01:36.891338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 104/183] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:36 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:37.912270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:37.912969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:37.915473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=34 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:37.921088 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:37.921534 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:37.922302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:37.923016 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:38.110410 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:38.122018 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3bbcb905-d1e2-44f5-bdd7-810bbe7f80e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.213410 Jul 26 05:01:38.122722 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 80/184] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:37 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:39.143673 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:39.144422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:39.151662 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.152084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.152849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:39.153605 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:39.293470 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:39.302439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7bb97f86-272d-4c2a-873d-e5518fbfd944 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.162835 Jul 26 05:01:39.303023 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 105/185] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:39 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:40.325139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:40.325674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:40.332881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:40.333321 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:40.339823 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:40.340382 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:40.479806 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:40.488490 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-704de8d3-5b13-4ee8-a526-e0710ff61920 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.168151 Jul 26 05:01:40.489074 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 81/186] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:40 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:41.512528 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:41.513129 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:41.519715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:41.520826 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:41.520992 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:41.521352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:41.660758 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:41.669636 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-bc495463-0c39-4e20-b59d-56accf0f7ea8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.160880 Jul 26 05:01:41.670238 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 106/187] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:41 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:42.692735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:42.693868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:42.705661 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.706243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.707148 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:42.707766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:42.852927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:42.855505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:42.863488 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7f3931d0-e6b3-43bf-8fc1-d9491431fcea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.175685 Jul 26 05:01:42.864188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 82/188] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:42 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:43.506967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:43.507539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:43.514021 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.514456 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.515211 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.515658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.545471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:01:43.592823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:43.657456 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0b7a4276-d5fa-49a8-b842-4a04fb88daf0 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 204 len: 0 microversion: 2.1 time: 0.153658 Jul 26 05:01:43.657989 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 107/189] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:43 2022] DELETE /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:01:43.668785 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:43.669604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:43.677863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.678475 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.679607 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.680152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.837191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:43.846753 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5f65b220-dd9e-49dc-b2c3-a8557621e167 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1553 microversion: 2.1 time: 0.184139 Jul 26 05:01:43.847336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 83/190] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:43 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:43.886889 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:43.887639 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:43.894238 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.894683 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:43.895750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:43.895916 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:44.054844 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:44.063424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1256b8a1-b106-42fe-b68c-9dbbe000e89f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.181012 Jul 26 05:01:44.064054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 108/191] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:43 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:44.868516 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:44.869137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:44.877900 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:44.878493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:44.879703 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:44.880150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.016581 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:45.025336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1c42ea5b-c9d9-4dec-99a4-e5e797f8ca6e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1553 microversion: 2.1 time: 0.160665 Jul 26 05:01:45.025762 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 84/192] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:44 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:45.086329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:45.086927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:45.089000 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:45.094393 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.094826 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.095585 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:45.096017 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:45.251203 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:45.259865 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-526c2ba6-e6b0-4b0f-ab7d-ccecb47c19af tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.177432 Jul 26 05:01:45.260444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 109/193] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:45 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:46.046950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:46.047650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:46.055602 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.056050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.056811 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.057381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.214257 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:46.223651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9425a984-b4a2-4a7c-b2b1-3c12333b0a80 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1553 microversion: 2.1 time: 0.181152 Jul 26 05:01:46.224335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 85/194] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:46 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:46.281299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:46.281900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:46.288423 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.289195 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.289915 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:46.290331 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:46.649314 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:46.657849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1b2c7ef4-d148-49a3-bc8f-3794c729da50 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.380167 Jul 26 05:01:46.658718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 110/195] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:46 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:47.246841 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:47.247593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:47.254696 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.255133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.255954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.256373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.398865 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:47.410061 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-39e2630b-d2e7-4c13-b2df-31647ce03f5e tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1553 microversion: 2.1 time: 0.167817 Jul 26 05:01:47.410932 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 86/196] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:47 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:47.490845 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-edf8a10a-5a3a-4e91-9a18-deecce1f8d6d req-c8bb5340-37ca-4407-a399-94313098171d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aaf576-9983-4dfb-b436-2bb04e2deddc", "name": "network-vif-deleted", "tag": "5ac2aa1d-8120-41dd-8ac5-91308f607903"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:01:47.501252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-edf8a10a-5a3a-4e91-9a18-deecce1f8d6d req-c8bb5340-37ca-4407-a399-94313098171d service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.501727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-edf8a10a-5a3a-4e91-9a18-deecce1f8d6d req-c8bb5340-37ca-4407-a399-94313098171d service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.514938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-edf8a10a-5a3a-4e91-9a18-deecce1f8d6d req-c8bb5340-37ca-4407-a399-94313098171d service nova] Creating event network-vif-deleted:5ac2aa1d-8120-41dd-8ac5-91308f607903 for instance c8aaf576-9983-4dfb-b436-2bb04e2deddc on hv-cinder-85057 Jul 26 05:01:47.520539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-edf8a10a-5a3a-4e91-9a18-deecce1f8d6d req-c8bb5340-37ca-4407-a399-94313098171d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033489 Jul 26 05:01:47.521168 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 111/197] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:01:47.680658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:47.681178 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:47.687665 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.688173 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.688905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:47.689351 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:47.831596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:47.839703 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1ee930b3-f140-49cf-802a-d499dd4db9d8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.163045 Jul 26 05:01:47.840290 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 87/198] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:47 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:48.433160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:48.433851 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:48.441197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.441638 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.442485 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.442817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.508235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:48.518422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-19204343-5ab0-4859-802f-668e0bb4ea56 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1511 microversion: 2.1 time: 0.089543 Jul 26 05:01:48.519162 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 112/199] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:48 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:48.864007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:48.864689 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:48.873773 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.874318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:48.875609 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:48.876301 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.013022 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:49.020939 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4ca5aeed-208d-4ac8-be5a-2c98d7f86a24 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.163047 Jul 26 05:01:49.021577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 88/200] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:48 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:49.540361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:49.541395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:49.548570 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.549007 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.549805 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:49.550228 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:49.629854 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:49.638400 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fa872ab3-7871-483a-8b49-c41cb249a2a8 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1346 microversion: 2.1 time: 0.101928 Jul 26 05:01:49.638950 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 113/201] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:49 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:50.042655 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:50.043264 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:50.049901 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:50.050365 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.051121 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:50.052199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.196728 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:50.205969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-facbb885-d3a6-462b-8eff-d19905fdb136 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.167321 Jul 26 05:01:50.206567 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 89/202] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:50 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:50.660174 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:50.660836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:50.667205 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:50.667800 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.668658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:50.669173 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:50.734322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:50.743907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1a84b764-1207-4bd4-9db3-19d5069f89ff tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1346 microversion: 2.1 time: 0.087734 Jul 26 05:01:50.744516 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 114/203] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:50 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:51.228596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:51.229183 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:51.237508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.237952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:51.238746 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.239174 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:51.395160 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:51.402755 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-11725c6e-454e-478d-a0a2-a7f140040c86 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.178405 Jul 26 05:01:51.403309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 90/204] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:51 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:51.766887 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:51.767667 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:51.773869 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.774305 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:51.775063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:51.775480 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:51.840953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e86ac513aa4feda193e134c0bc9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981b76b8fd394154a07921073ab08ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:51.850705 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-23eb317b-c57e-48fb-912a-e588abb96481 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 200 len: 1346 microversion: 2.1 time: 0.088375 Jul 26 05:01:51.851608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 115/205] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:51 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:52.424088 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:52.424768 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:52.431318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:52.431821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:52.433333 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:52.433774 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:52.590567 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:52.599170 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-68a9d466-d55a-49bb-80d5-763689eb29b8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.179027 Jul 26 05:01:52.599902 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 91/206] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:52 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:52.874327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:52.876455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:52.883083 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:52.883674 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:52.884505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:52.885003 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:52.899666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] HTTP exception thrown: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Request method failure captured: Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc HTTP/1.1 Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TkoHUhndDnh0c7mEC_UrNt95y5RCNNVavBl0HgFJepfZg4H8eYauf-Uwqk_0S_wfotMEhve1YLzeFM-MKcqIcFkC1V0cWthvbHB4nK3UZ9Gdei0fmOEB9olUwJcWjtkdZGNjhC7JWQPQXYiNA-6XKpe-zUJVkBiNbPSTNE92RktZ8 Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:01:52.905848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_981b76b8fd394154a07921073ab08ed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}] Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: f4e86ac513aa4feda193e134c0bc9e79 Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:52.909896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'c8aaf576-9983-4dfb-b436-2bb04e2deddc'} Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:52.910960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:52.916658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:52.918041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Returning 404 to user: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:52.918041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e8a0447c-7867-465a-899b-1ff2116aa789 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 404 len: 111 microversion: 2.1 time: 0.038065 Jul 26 05:01:52.918041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 116/207] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:52 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:53.039001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:53.042069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:53.059801 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.060487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.061387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.064049 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.089948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] HTTP exception thrown: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Request method failure captured: Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc/os-volume_attachments HTTP/1.1 Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TkoHUhndDnh0c7mEC_UrNt95y5RCNNVavBl0HgFJepfZg4H8eYauf-Uwqk_0S_wfotMEhve1YLzeFM-MKcqIcFkC1V0cWthvbHB4nK3UZ9Gdei0fmOEB9olUwJcWjtkdZGNjhC7JWQPQXYiNA-6XKpe-zUJVkBiNbPSTNE92RktZ8 Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:01:53.098844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_981b76b8fd394154a07921073ab08ed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}] Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f4e86ac513aa4feda193e134c0bc9e79 Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:53.100292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'server_id': 'c8aaf576-9983-4dfb-b436-2bb04e2deddc'} Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:53.101092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:53.102458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:53.104855 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Returning 404 to user: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:53.105841 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-14672678-f590-4ba3-b253-757890713e7f tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.070945 Jul 26 05:01:53.106773 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 92/208] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:01:53 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc/os-volume_attachments => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:53.623301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:53.623980 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:53.630121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.630830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.631820 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:53.632291 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:53.776263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:53.784952 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-35f22325-2c5c-4e76-9a3c-a7375081adbe tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.165221 Jul 26 05:01:53.785552 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 117/209] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:53 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:54.346251 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:54.346757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:54.356323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.356757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:54.357803 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.358302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:54.374672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] HTTP exception thrown: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Request method failure captured: Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc HTTP/1.1 Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TkoHUhndDnh0c7mEC_UrNt95y5RCNNVavBl0HgFJepfZg4H8eYauf-Uwqk_0S_wfotMEhve1YLzeFM-MKcqIcFkC1V0cWthvbHB4nK3UZ9Gdei0fmOEB9olUwJcWjtkdZGNjhC7JWQPQXYiNA-6XKpe-zUJVkBiNbPSTNE92RktZ8 Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:01:54.377140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_981b76b8fd394154a07921073ab08ed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}] Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f4e86ac513aa4feda193e134c0bc9e79 Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.378640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'c8aaf576-9983-4dfb-b436-2bb04e2deddc'} Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:54.379577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.380658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.381770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Returning 404 to user: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:54.381770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9f14e791-4ac3-4dd8-ac0e-edde478fd126 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 404 len: 111 microversion: 2.1 time: 0.037602 Jul 26 05:01:54.381770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 93/210] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:01:54 2022] DELETE /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:54.390084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:54.391338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] [instance: c8aaf576-9983-4dfb-b436-2bb04e2deddc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:54.401503 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.402154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:54.402923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.403527 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:54.418187 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] HTTP exception thrown: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Request method failure captured: Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc HTTP/1.1 Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TkoHUhndDnh0c7mEC_UrNt95y5RCNNVavBl0HgFJepfZg4H8eYauf-Uwqk_0S_wfotMEhve1YLzeFM-MKcqIcFkC1V0cWthvbHB4nK3UZ9Gdei0fmOEB9olUwJcWjtkdZGNjhC7JWQPQXYiNA-6XKpe-zUJVkBiNbPSTNE92RktZ8 Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:01:54.419938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_981b76b8fd394154a07921073ab08ed6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/981b76b8fd394154a07921073ab08ed6"}]}] Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 981b76b8fd394154a07921073ab08ed6 Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-DeleteServersTestJSON-374598982 Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: f4e86ac513aa4feda193e134c0bc9e79 Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-DeleteServersTestJSON-374598982-project Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.421580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'c8aaf576-9983-4dfb-b436-2bb04e2deddc'} Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:01:54.422479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. Jul 26 05:01:54.423875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:01:54.425283 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] Returning 404 to user: Instance c8aaf576-9983-4dfb-b436-2bb04e2deddc could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:01:54.425283 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f585b7c0-2d18-45a9-ad30-b2476727d972 tempest-DeleteServersTestJSON-374598982 tempest-DeleteServersTestJSON-374598982-project] 10.222.0.17 "GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc" status: 404 len: 111 microversion: 2.1 time: 0.036789 Jul 26 05:01:54.425283 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 118/211] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:54 2022] GET /compute/v2.1/servers/c8aaf576-9983-4dfb-b436-2bb04e2deddc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:01:54.807428 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:54.808406 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:54.816218 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.816856 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:54.817776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:54.818322 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:55.044330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:55.053778 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-78261f23-8336-408c-8d0c-104507cc7434 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.251282 Jul 26 05:01:55.054678 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 94/212] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:54 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:56.078514 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:56.080111 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:56.087407 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.088042 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.088822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:56.089248 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:56.359327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:56.368199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1119e7f3-dede-4f62-b51a-aadbd468e18e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.295403 Jul 26 05:01:56.368792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 119/213] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:56 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:57.393368 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:57.393833 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:57.405030 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:57.405564 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:57.406306 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:57.410573 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:57.599508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:57.607435 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-23f52a40-3aca-4d1f-9150-99ca91614a7a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.218807 Jul 26 05:01:57.608210 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 95/214] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:57 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:01:58.629296 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:58.630638 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:58.644084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:58.644903 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:58.645777 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:58.646593 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:58.831354 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:01:58.841689 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-68b4cc12-cd1e-4eda-a98f-707aa91ae902 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.216358 Jul 26 05:01:58.842747 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 120/215] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:58 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:01:59.866491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:01:59.867826 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:01:59.895413 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:59.898418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:01:59.899412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:01:59.901729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:00.100397 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:00.115287 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2e8994ed-fd7d-43c8-88db-9d104f64d1b7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.253585 Jul 26 05:02:00.116082 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 96/216] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:01:59 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:01.144140 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:01.145499 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:01.152635 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:01.153279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:01.154204 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:01.154967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:01.348188 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:01.361322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-92123163-02c6-4544-9309-b958fd36ae4a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.218895 Jul 26 05:02:01.362087 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 121/217] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:01 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:02.389879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:02.391232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:02.398081 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:02.398727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:02.399484 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:02.400071 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:02.541208 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:02.548742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a7ba0efd-628e-49a9-a437-e6e3c5b589db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.168111 Jul 26 05:02:02.549316 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 97/218] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:02 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:03.571761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:03.572479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:03.584246 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:03.584707 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:03.586905 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:03.587281 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:03.771934 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:03.793416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6ce21f96-5744-4b12-baed-c58ecec1864e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.227250 Jul 26 05:02:03.793998 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 122/219] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:03 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:04.814279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:04.814900 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:04.821823 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:04.822273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:04.823037 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:04.823888 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:04.983997 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:04.995479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1a97e615-2f92-43c6-80a7-0a911ac02d6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.184679 Jul 26 05:02:04.996597 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 98/220] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:04 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:06.018049 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:06.018618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:06.025924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:06.026361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:06.027113 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:06.027504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:06.168229 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:06.175903 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-de4b8b26-e69d-45f9-8923-300c63ade1c8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.161798 Jul 26 05:02:06.176469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 123/221] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:06 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:07.197254 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:07.197897 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:07.205097 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:07.205439 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:07.206204 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:07.206637 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:07.347216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:07.355116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-89915e22-d806-4afb-b643-600e4ebe4a58 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.161774 Jul 26 05:02:07.355708 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 99/222] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:07 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:08.377389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:08.378005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:08.385651 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:08.386187 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:08.387037 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:08.387533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:08.535940 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:08.544276 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d531554e-c810-421a-a1f8-34722924a981 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.170770 Jul 26 05:02:08.544999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 124/223] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:08 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:09.566186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:09.567643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:09.571264 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=40 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:09.577610 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:09.578050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:09.578832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:09.579262 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:09.733439 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:09.735434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:09.743277 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-93d46d4c-c747-4b91-a7f6-d5b1f36c5069 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.180832 Jul 26 05:02:09.756000 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 100/224] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:09 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:10.766330 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:10.766927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:10.773322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:10.773914 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:10.775463 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:10.776025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:10.969014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:10.972544 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:10.977478 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6b28edcb-68a2-4cd0-9bc9-d8e211e2ae9c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.214966 Jul 26 05:02:10.978059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 125/225] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:10 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:11.999150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:11.999790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:12.007450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:12.007926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:12.008699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:12.009148 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:12.164931 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:12.173052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3be8fc39-b036-41c0-baf4-91100a766b18 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.178191 Jul 26 05:02:12.173629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 101/226] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:11 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:12.492625 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-83e4457a-749a-474b-bbcb-acbbb62c0132 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:12.493168 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-83e4457a-749a-474b-bbcb-acbbb62c0132 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:12.508838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83e4457a-749a-474b-bbcb-acbbb62c0132 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:12.508838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83e4457a-749a-474b-bbcb-acbbb62c0132 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:12.508838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83e4457a-749a-474b-bbcb-acbbb62c0132 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:12.508838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-83e4457a-749a-474b-bbcb-acbbb62c0132 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:12.529616 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-83e4457a-749a-474b-bbcb-acbbb62c0132 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/ips" status: 200 len: 146 microversion: 2.1 time: 0.042923 Jul 26 05:02:12.530242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 126/227] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:02:12 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:13.196465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:13.198503 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:13.209350 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:13.210153 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:13.211236 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:13.212378 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:13.408258 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:13.419273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-174f623e-7bb1-45c6-b047-c3a6a9ad4f30 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.228760 Jul 26 05:02:13.419875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 102/228] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:13 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:14.445025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:14.447253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:14.455920 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:14.456699 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:14.457788 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:14.458465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:14.653303 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:14.660855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-257ce565-e60c-464d-a4ae-34096243cade tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.221734 Jul 26 05:02:14.661604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 127/229] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:14 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:15.685427 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:15.686514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:15.698596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:15.700822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:15.702544 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:15.703850 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:16.022706 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:16.030797 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5cd92df8-de4c-41ed-9591-060e1d35875d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.352231 Jul 26 05:02:16.031396 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 103/230] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:15 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:16.692927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-99e3532f-663b-433e-ac17-53dd0155daa3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aefce1c-a9bd-4c80-871e-4e2050de8347"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:16.696053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-99e3532f-663b-433e-ac17-53dd0155daa3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:16.698433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=38 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:16.704472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99e3532f-663b-433e-ac17-53dd0155daa3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:16.704917 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99e3532f-663b-433e-ac17-53dd0155daa3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:16.705704 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99e3532f-663b-433e-ac17-53dd0155daa3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:16.706131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99e3532f-663b-433e-ac17-53dd0155daa3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:17.066909 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:17.067641 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:17.078164 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:17.081247 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:17.082791 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:17.083695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:17.307844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:17.330465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f8a28687-f551-4937-a2e1-a2c344fad9dc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1521 microversion: 2.1 time: 0.268228 Jul 26 05:02:17.335545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 104/231] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:17 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:17.356136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-99e3532f-663b-433e-ac17-53dd0155daa3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667077 Jul 26 05:02:17.374096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 128/232] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:02:16 2022] POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:18.358491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:18.359074 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:18.367696 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.368492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.369552 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.370377 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.560223 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:18.571008 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ce7e336b-06b4-42d6-ac5e-b1bbba9c8613 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1501 microversion: 2.1 time: 0.217586 Jul 26 05:02:18.573435 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 105/233] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:18 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:18.615057 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:18.615702 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:18.623263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.623747 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.624528 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.624954 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.776646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:18.784286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a43d721f-00e0-4298-a2d0-951a11ad12ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1515 microversion: 2.1 time: 0.184347 Jul 26 05:02:18.785410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 129/234] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:18 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:18.810806 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-837e00c5-c133-4e39-a03c-3a5b88f6556e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:18.811312 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-837e00c5-c133-4e39-a03c-3a5b88f6556e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:18.817793 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-837e00c5-c133-4e39-a03c-3a5b88f6556e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.818437 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-837e00c5-c133-4e39-a03c-3a5b88f6556e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.819386 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-837e00c5-c133-4e39-a03c-3a5b88f6556e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:18.820032 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-837e00c5-c133-4e39-a03c-3a5b88f6556e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:18.852045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-837e00c5-c133-4e39-a03c-3a5b88f6556e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/ips" status: 200 len: 150 microversion: 2.20 time: 0.045538 Jul 26 05:02:18.852659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 106/235] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Jul 26 05:02:18 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:02:20.541063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:20.544190 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:20.551711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:20.552153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:20.553091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:20.553982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:20.579239 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lazy-loading 'flavor' on Instance uuid 3f4c17ac-a751-4ebc-9a68-b051d32dc63f {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:02:20.673832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-abab8333-a452-4ac5-969b-3e9f2c2d81f9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f/action" status: 200 len: 32 microversion: 2.1 time: 0.136496 Jul 26 05:02:20.674457 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 130/236] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:02:20 2022] POST /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:02:20.688886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:20.693281 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:20.707746 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:20.708399 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:20.709465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:20.713086 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:20.873785 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:20.885182 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-abfd1ae5-b782-4f38-be5a-ef574dddc051 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.203533 Jul 26 05:02:20.886000 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 107/237] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:20 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:21.257795 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:21.258418 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:21.265360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.265805 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:21.266569 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.266999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:21.453486 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lazy-loading 'flavor' on Instance uuid 02b3bcc1-fe56-4edd-b25a-a2c338610939 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:02:21.676182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3ad8c434-668a-420a-8ab0-5e651128d834 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/action" status: 202 len: 0 microversion: 2.20 time: 0.423345 Jul 26 05:02:21.677755 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 131/238] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Jul 26 05:02:21 2022] POST /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:02:21.686659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:21.688146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:21.695571 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.696148 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:21.699924 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.700356 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:21.854563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:21.864066 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:21.865581 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:21.866796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-efed409e-97e0-4a61-9c83-c97b64b2228b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.184480 Jul 26 05:02:21.867772 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 108/239] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:21 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:21.914666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:21.916647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:21.925756 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.926191 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:21.927317 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:21.928075 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:22.081367 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:22.089001 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c44b37f7-4efe-426f-af8a-db9dd6643940 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.179243 Jul 26 05:02:22.089578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 132/240] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:21 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:22.893364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:22.893939 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:22.901111 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:22.901633 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:22.902522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:22.903017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:23.048053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:23.064614 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:23.066083 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:23.067669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c4eced38-34db-4072-9c54-c563873b5ce2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.178080 Jul 26 05:02:23.068226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 109/241] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:22 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:23.110235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:23.110816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:23.118965 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:23.119925 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:23.120855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:23.121447 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:23.282236 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:23.292035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4a5922fd-7577-424a-b86a-e48c60a785c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.185449 Jul 26 05:02:23.292981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 133/242] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:23 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:24.106922 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:24.121336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:24.134010 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:24.135589 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:24.136752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:24.137666 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:24.290337 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:24.304729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:24.306392 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:24.309430 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-feac5f8b-cdd2-4125-a3ac-a673bd70f7a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.219148 Jul 26 05:02:24.310207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 110/243] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:24 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:24.313967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:24.315182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:24.323802 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:24.324602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:24.325987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:24.326643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:24.476210 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:24.485847 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fb1cc53f-0e08-43db-81c5-61d134606d4e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.175488 Jul 26 05:02:24.486632 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 134/244] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:24 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:25.335117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:25.337730 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:25.346607 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:25.347448 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:25.348658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:25.353299 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:25.509947 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:25.511368 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:25.520054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:25.520475 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:25.521400 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:25.522035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:25.589152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:25.598171 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:25.599994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:25.603030 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-194fdcfa-150f-4edd-b76f-a157e9bfbe63 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.272805 Jul 26 05:02:25.604005 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 111/245] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:25 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:25.739953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:25.748395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-48a86e21-b54d-489f-be90-82ab9bcac31a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.244380 Jul 26 05:02:25.748983 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 135/246] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:25 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:26.629243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:26.629873 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:26.639100 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:26.639945 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:26.641061 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:26.641679 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:26.769426 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:26.770672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:26.777102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:26.777543 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:26.778506 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:26.778936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:26.784988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:26.793478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:26.795658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:26.797122 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fdb73f1a-572f-4fda-a886-3399c837b6fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.173189 Jul 26 05:02:26.797678 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 112/247] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:26 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:26.914169 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:26.922156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-96b6588b-ecf1-4a31-a00e-5287c3891798 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.156451 Jul 26 05:02:26.922731 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 136/248] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:26 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:27.822053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:27.823210 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:27.829897 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:27.830327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:27.831163 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:27.831603 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:27.944360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:27.945883 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:27.954347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:27.958849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:27.960482 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:27.961053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:27.984370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:28.025798 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:28.034830 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:28.036399 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:28.037655 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-63e536b2-bafb-43d1-9ea2-c298ecb171b8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.220491 Jul 26 05:02:28.038384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 113/249] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:27 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:28.143668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:28.152646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-300cfad6-4a49-4b8e-b431-5a6c2e110603 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.212519 Jul 26 05:02:28.153311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 137/250] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:27 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:28.271851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fae429ad-832f-470b-a947-304fbe28ea34 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:28.278123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fae429ad-832f-470b-a947-304fbe28ea34 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:28.278563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fae429ad-832f-470b-a947-304fbe28ea34 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:28.343874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fae429ad-832f-470b-a947-304fbe28ea34 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Going to try to stop instance {{(pid=117993) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 05:02:28.404653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fae429ad-832f-470b-a947-304fbe28ea34 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action" status: 202 len: 0 microversion: 2.1 time: 0.136349 Jul 26 05:02:28.405669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 114/251] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:02:28 2022] POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:02:28.420176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:28.420821 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:28.428300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:28.428817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:28.429587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:28.430025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:28.570763 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:28.581076 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ffd3b564-1858-485c-8ed5-9ee2ca850737 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.170719 Jul 26 05:02:28.588643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 138/252] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:28 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:29.067596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:29.068587 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:29.076875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.077302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.078238 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.078660 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.173850 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:29.174516 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:29.181282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.181972 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.182733 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.183309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.214064 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:29.232667 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:29.234983 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:29.236456 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d02ad4e8-56bd-4373-ba8e-6f3d97d1bb51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.177753 Jul 26 05:02:29.251539 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 115/253] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:29 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:29.325024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:29.337008 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1eec74a2-c599-41cc-b301-c0ca9eb2d8e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.166728 Jul 26 05:02:29.337899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 139/254] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:29 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:29.605119 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:29.605740 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:29.614091 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.614525 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.615753 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:29.616177 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:29.759486 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:29.761891 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:29.768682 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e0e8686d-d83d-4877-8524-087ae2ab8fd9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.169938 Jul 26 05:02:29.769242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 116/255] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:29 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:30.265988 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:30.266844 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:30.275372 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.275878 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.276688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.277116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.361464 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:30.362509 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:30.370012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.370458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.371227 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.371690 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.425241 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:30.433611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:30.435151 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:30.436373 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-69764359-d9be-4a5c-8669-b7d841f743c8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.177331 Jul 26 05:02:30.436936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 140/256] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:30 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:30.515774 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:30.528103 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aedf6f30-2143-48f3-b898-cca6512505b0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.172466 Jul 26 05:02:30.528865 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 117/257] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:30 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:30.791672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:30.792240 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:30.798772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.799221 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.800025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:30.800456 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:30.949496 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:30.960888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-21f9801e-b785-451c-82e6-7daed905c43b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.173411 Jul 26 05:02:30.961513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 141/258] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:30 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:31.462943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:31.463642 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:31.471010 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:31.471453 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:31.472240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:31.472672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:31.553097 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:31.553696 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:31.561195 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:31.561534 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:31.562304 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:31.562727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:31.754230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:31.762999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8d319b0d-7193-4be0-887c-aac98580d042 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.213842 Jul 26 05:02:31.763587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 142/259] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:31 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:31.788162 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:31.796507 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:31.797965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:31.799141 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e20fe13e-b8fa-44c1-8d06-d1efd1b8c281 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.340213 Jul 26 05:02:31.799798 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 118/260] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:31 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:31.985581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:31.986297 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:31.994861 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:31.995341 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:31.996149 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:31.996563 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:32.148401 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:32.164237 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d0730ea7-b5f3-43a6-9c29-980df360194d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.182530 Jul 26 05:02:32.165362 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 143/261] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:31 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:32.783469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:32.784124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:32.790859 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:32.791298 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:32.792077 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:32.793534 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:32.824348 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:32.825066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:32.831923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:32.833022 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:32.833734 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:32.834326 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:32.982649 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:32.990534 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a36b41d7-88d4-4524-a466-00b5a63f6fda tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.210782 Jul 26 05:02:32.991180 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 119/262] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:32 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:33.017922 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:33.026807 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:33.028618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:33.029797 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2ea0ba9c-c96b-4e37-8e13-bd7b378ad462 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.211232 Jul 26 05:02:33.030332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 144/263] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:32 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:33.192446 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:33.193261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:33.200868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:33.201568 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:33.202527 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:33.203049 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:33.358063 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:33.366422 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-afa13272-e363-4a52-b8e6-c163bad3e713 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.178490 Jul 26 05:02:33.366987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 120/264] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:33 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:34.012655 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:34.013387 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:34.020393 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.020853 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.021724 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.022159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.054026 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:34.054627 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:34.061440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.061889 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.062631 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.063062 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.203374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:34.211595 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ad110be3-c846-4111-aedc-0ab4b383d72a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.203103 Jul 26 05:02:34.212168 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 145/265] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:34 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:34.235373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:34.245620 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:34.247133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:34.248356 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f981b947-5582-4093-b6e1-eb472986125e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.198359 Jul 26 05:02:34.248942 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 121/266] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:34 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:34.392403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:34.392715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:34.399189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.400316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.401408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:34.401834 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:34.535413 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:34.543703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3f5a8116-2243-411d-9e19-981693dcf155 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.155391 Jul 26 05:02:34.544253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 146/267] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:34 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:35.234947 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:35.235903 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:35.243817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.244293 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.245166 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.245923 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.271912 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:35.272723 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:35.281910 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.282347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.283129 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.283586 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.666045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:35.674447 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9c33373f-e160-41e7-a4c4-3dd8d8d79b0a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.444157 Jul 26 05:02:35.675244 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 122/268] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:35 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:35.684558 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:35.685233 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:35.693036 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.693495 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.694402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:35.694843 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:35.713430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:35.722268 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:35.724181 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:35.725387 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55a41946-095a-45b4-ac68-93219fdf1b26 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.457451 Jul 26 05:02:35.725949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 147/269] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:35 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:35.834717 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:35.843748 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dcb0779c-f18e-423e-a020-9105700a9aff tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.167003 Jul 26 05:02:35.844460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 123/270] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:35 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:36.698293 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:36.698988 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:36.707906 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:36.708485 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:36.709265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:36.709668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:36.757694 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:36.758270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:36.764975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:36.765449 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:36.766246 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:36.766693 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:36.887513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:36.895764 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-992e58ee-1877-427a-a05f-b1ce5b2b0bea tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.201790 Jul 26 05:02:36.896378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 148/271] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:36 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:36.903819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:36.904504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:36.915794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:36.916234 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:36.917002 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:36.917490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:36.932693 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:36.940953 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:36.942788 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:36.944067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4f41831d-47cd-4ad7-a645-6701db35faae tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.190712 Jul 26 05:02:36.944755 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 124/272] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:36 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:37.054378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:37.062783 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4e88a606-247c-4a5c-ac1e-be12165189ef tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.165323 Jul 26 05:02:37.063361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 149/273] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:36 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:37.918373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:37.919048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:37.926213 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:37.926661 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:37.927431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:37.927898 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:37.970304 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:37.971052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:37.983006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:37.983871 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:37.984893 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:37.985646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:38.189970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:38.193792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:38.198009 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bb2de5ae-40ed-4fef-96e1-067baea03b1f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.284064 Jul 26 05:02:38.198661 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 125/274] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:37 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:38.203293 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:38.203517 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:38.204144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:38.205433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:38.206421 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c3de8e6f-70dd-4d79-b886-731b4640a5e0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.241548 Jul 26 05:02:38.207072 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 150/275] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:37 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:38.210208 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:38.210834 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:38.211642 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:38.212069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:38.354832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:38.363349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-37c0b945-f445-48e7-b134-f1bd76199976 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.163547 Jul 26 05:02:38.364183 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 126/276] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:38 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:39.220910 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:39.222076 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:39.228701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.229151 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.230027 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.230647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.231256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:39.232273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:39.243840 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.245409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.246841 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.248017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.446289 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:39.459822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:39.475974 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:39.478223 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:39.479976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a2f67e7c-79d3-4aca-8d30-7e8d743aea11 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.253288 Jul 26 05:02:39.481128 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7616676b-961a-4550-a82e-b6bd21c2ca52 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.258849 Jul 26 05:02:39.481590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 127/277] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:39 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:02:39.482310 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 151/278] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:39 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:39.487048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:39.488323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:39.496085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.496730 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.497639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:39.498476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:39.711925 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:39.725153 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ab46c74f-cb82-4190-9179-f5808a0038de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.242235 Jul 26 05:02:39.726029 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 128/279] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:39 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:40.504514 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:40.506247 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:40.512039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:40.512710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:40.514692 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.515091 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=58 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:40.515904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.517366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.518302 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.520999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.521444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.522222 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.522652 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.750811 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:40.763924 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:40.766057 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:40.767824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-053c13f3-1086-41c5-a91e-c12febb1011f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.263111 Jul 26 05:02:40.769012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 129/280] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:40 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:02:40.775455 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:40.777829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:40.787412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.788205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.790522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:40.791346 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:40.803393 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:40.816839 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dc0128e4-7293-49c1-accc-5014177b2a62 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.316488 Jul 26 05:02:40.817479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 152/281] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:40 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:40.949914 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:40.958054 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c73fc9d9-ab20-4d32-8ba4-43c87d47c8da tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.187811 Jul 26 05:02:40.958629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 130/282] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:40 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:41.797430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:41.798036 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:41.804795 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:41.805241 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:41.806014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:41.806444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:41.840698 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:41.841287 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:41.848084 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:41.848530 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:41.849336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:41.849765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:42.004438 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:42.013880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:42.015810 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:42.017260 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e6d181d7-05ad-401c-954a-2585b532be5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.223767 Jul 26 05:02:42.017985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 153/283] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:41 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:42.023312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:42.023875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:42.023982 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:42.030039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:42.030479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:42.031381 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:42.031981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:42.032964 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2672bdd5-93fb-4469-8dd8-413edce57b55 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.196405 Jul 26 05:02:42.036604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:42.047179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 131/284] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:41 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:42.179740 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:42.191820 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-acb13e3e-ef3e-4b5a-8258-888e01377459 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.169850 Jul 26 05:02:42.191820 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 154/285] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:42 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:43.044801 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:43.045372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:43.052484 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.052927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.053692 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.054127 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.054341 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:43.054944 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:43.062081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.062651 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.063420 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.063895 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.256276 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:43.259247 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:43.264292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4a501284-abb2-4093-b4bd-b0ffb15701a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.213896 Jul 26 05:02:43.264864 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 155/286] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:43 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:43.267665 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:43.269240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:43.269383 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:43.269870 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:43.270589 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-010504f8-22f1-4446-bd97-81914068b44d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.232072 Jul 26 05:02:43.271535 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 132/287] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:43 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:43.275849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.276502 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.277264 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:43.277694 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:43.408842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:43.419934 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3e3aff17-be8e-4a66-8a77-4ca44c5788a7 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.154033 Jul 26 05:02:43.420516 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 156/288] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:43 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:44.285549 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:44.286173 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:44.293133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.293572 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.294357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.294529 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:44.294960 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.295249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:44.302660 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.303177 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.303982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.304399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.324731 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:44.526593 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:44.538585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:44.541957 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:44.546120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ec0bcb72-f647-450c-8a1d-6654ae63a825 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.264372 Jul 26 05:02:44.546750 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 133/289] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:44 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:44.549500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:44.550696 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e5cb29e3-c4a7-435f-b840-4b1fa9cdab2d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1743 microversion: 2.20 time: 0.260461 Jul 26 05:02:44.565579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:44.565920 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 157/290] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:44 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1743 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:02:44.566552 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:44.574482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.574926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.575742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:44.576172 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:44.715229 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:44.723747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c0c8da69-e974-4315-855e-03c49cd9bf10 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.176000 Jul 26 05:02:44.724325 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 134/291] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:44 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:45.571062 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:45.572046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:45.579052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:45.579604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.579604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.579827 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:45.580395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.580820 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.586673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.587625 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.588108 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.588612 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.785734 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:45.789791 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:45.793545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c452f0db-84fe-4d94-b7a3-e4e3957ad57a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.228204 Jul 26 05:02:45.794165 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 158/292] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:45 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:45.798121 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:45.798841 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:45.799474 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:45.799617 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:45.800791 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7fa39fe3-f725-41f5-9b0d-fb8edb541a6a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1743 microversion: 2.20 time: 0.225941 Jul 26 05:02:45.801608 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 135/293] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:45 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:02:45.805577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.806024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.806793 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:45.807229 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:45.952721 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:45.961319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d57b573a-2e03-41a3-9f19-7d9c50092e5c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.166220 Jul 26 05:02:45.961889 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 159/294] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:45 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:46.817709 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:46.818322 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:46.825282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:46.826438 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:46.828741 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=64 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:46.830946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:46.831364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:46.835524 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:46.836208 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:46.837312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:46.837886 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:46.851832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:46.851832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:47.132966 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:47.146581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:47.148715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:47.150052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-aac24f84-5578-4530-9764-916727292f55 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1743 microversion: 2.20 time: 0.329582 Jul 26 05:02:47.150815 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 160/295] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:46 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1743 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:02:47.153336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:47.155463 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:47.156231 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:47.163090 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:47.163681 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:47.165200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:47.165742 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:47.170585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ee09cf07-c009-45d6-af82-3569d0d9e6ba tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.356755 Jul 26 05:02:47.171680 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 136/296] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:46 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:47.308050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:47.316761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3d08ac77-b0d6-45fc-82db-00a48e403e0a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.164839 Jul 26 05:02:47.317336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 161/297] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:47 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:47.364368 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-9b917dfe-17a3-40b8-8405-a33b6a23f8ad req-7907b852-0f85-473d-b387-970c1fba0a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b3bcc1-fe56-4edd-b25a-a2c338610939", "name": "network-vif-plugged", "status": "completed", "tag": "a540d166-7fe8-4084-911e-a2037b5f9fd5"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:47.380632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9b917dfe-17a3-40b8-8405-a33b6a23f8ad req-7907b852-0f85-473d-b387-970c1fba0a0e service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:47.381340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9b917dfe-17a3-40b8-8405-a33b6a23f8ad req-7907b852-0f85-473d-b387-970c1fba0a0e service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:47.401700 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-9b917dfe-17a3-40b8-8405-a33b6a23f8ad req-7907b852-0f85-473d-b387-970c1fba0a0e service nova] Creating event network-vif-plugged:a540d166-7fe8-4084-911e-a2037b5f9fd5 for instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 on hv-cinder-85057 Jul 26 05:02:47.408123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-9b917dfe-17a3-40b8-8405-a33b6a23f8ad req-7907b852-0f85-473d-b387-970c1fba0a0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047891 Jul 26 05:02:47.409436 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 137/298] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:02:48.179768 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:48.181327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:48.195902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:48.197137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:48.198137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:48.198793 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:48.200663 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:48.202320 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:48.213190 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:48.213837 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:48.215773 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:48.220908 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:48.465487 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:48.475577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:48.477105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:48.478304 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-381cbd35-1ff0-4742-a1ac-1ea39badb950 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.307443 Jul 26 05:02:48.478856 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 162/299] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:48 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:48.483507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:48.484311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:48.490498 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:48.491121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:48.492097 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:48.492672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:48.499748 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:48.507193 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8c8a9a43-62ff-4ed9-8916-1da94e946004 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.313792 Jul 26 05:02:48.508016 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 138/300] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:48 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:48.631367 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:48.640015 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-06d2c1bc-f6df-44d4-b5ec-8b9632729fa5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1723 microversion: 2.1 time: 0.159980 Jul 26 05:02:48.640670 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 163/301] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:48 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:49.502299 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:49.505524 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:49.513793 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.515458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.516346 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.516854 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.529581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:49.530814 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:49.542064 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.542694 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.543822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.544245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.795296 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:49.799631 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:49.808933 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a4dc5149-1734-4214-8a4b-56799fc6811a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1501 microversion: 2.1 time: 0.284210 Jul 26 05:02:49.810408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 164/302] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:49 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:49.811958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:49.813979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:49.815396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:49.815973 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8038f4d1-ece6-4b7e-b793-29d56a33e790 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.318746 Jul 26 05:02:49.816096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:49.822590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.823367 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.824440 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.825037 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.836488 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 139/303] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:49 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:49.843445 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d76a33a-c7a6-4e6d-a927-0ddd0afbea0c"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:49.847798 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:49.856379 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.857397 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.858335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.859023 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.891716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] HTTP exception thrown: Cannot 'attach_volume' instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f while it is in vm_state rescued Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Request method failure captured: Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: POST /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f/os-volume_attachments HTTP/1.1 Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 74 Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TppTZEIzE22-l0k1qVXQWFi1a4JpacOX6I-ukPvNKWTV4LGXoFjlyR-pLI_c381psvsgMHG-u3LvGb0svyIeLIyuUv9BMz_8zzxmMG2arWGttFKsDh22CIjO14XDEMubNks0nJxAMMTXQ83lZ7CLF6KWj8TGQFie_JksEnHe0O0bM Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:02:49.893727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}] Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f0cc1af7d7d642889a1a11103f087e79 Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {"volumeAttachment": {"volumeId": "9d76a33a-c7a6-4e6d-a927-0ddd0afbea0c"}} Jul 26 05:02:49.895307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Cannot 'attach_volume' instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f while it is in vm_state rescued Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'server_id': '3f4c17ac-a751-4ebc-9a68-b051d32dc63f', 'body': {'volumeAttachment': {'volumeId': '9d76a33a-c7a6-4e6d-a927-0ddd0afbea0c'}}} Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:02:49.896280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f while it is in vm_state rescued Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:02:49.897650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:02:49.898970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:02:49.898970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:02:49.898970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f while it is in vm_state rescued Jul 26 05:02:49.898970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:02:49.900843 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Returning 409 to user: Cannot 'attach_volume' instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f while it is in vm_state rescued {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:02:49.902080 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-89799155-4669-4ba3-ad18-b6dcdfc7b553 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064061 Jul 26 05:02:49.902870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 140/304] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:02:49 2022] POST /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 05:02:49.919108 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a8dd420c-df98-46be-bc9b-b6457606abbc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:49.920986 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a8dd420c-df98-46be-bc9b-b6457606abbc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:49.927959 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a8dd420c-df98-46be-bc9b-b6457606abbc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.928666 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a8dd420c-df98-46be-bc9b-b6457606abbc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:49.929618 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a8dd420c-df98-46be-bc9b-b6457606abbc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:49.930825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a8dd420c-df98-46be-bc9b-b6457606abbc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.036400 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a8dd420c-df98-46be-bc9b-b6457606abbc tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f/action" status: 202 len: 0 microversion: 2.1 time: 0.127975 Jul 26 05:02:50.041219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 141/305] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:02:49 2022] POST /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:02:50.060890 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:50.062460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:50.071702 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.072372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.073318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.074214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.150816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:50.163347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c6b3eefa-e1ce-48f1-ae84-623b1762fed4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1700 microversion: 2.1 time: 0.351710 Jul 26 05:02:50.164180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 165/306] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:49 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1700 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:50.192349 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-368ce93c-3a8d-41fa-8341-63796d31ed21 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:50.202951 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-368ce93c-3a8d-41fa-8341-63796d31ed21 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.210077 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-368ce93c-3a8d-41fa-8341-63796d31ed21 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.366067 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-368ce93c-3a8d-41fa-8341-63796d31ed21 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Going to try to start instance {{(pid=117994) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 05:02:50.442813 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:50.460014 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-66ec3cb0-9918-4469-9fd4-579493f1c68c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1509 microversion: 2.1 time: 0.402240 Jul 26 05:02:50.461027 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 142/307] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:50 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:50.472938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-368ce93c-3a8d-41fa-8341-63796d31ed21 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action" status: 202 len: 0 microversion: 2.1 time: 0.285497 Jul 26 05:02:50.475718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 166/308] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:02:50 2022] POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:02:50.484908 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:50.485433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:50.491791 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.492260 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.493607 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.494101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.697226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:50.706648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8efb6d2b-c84e-4186-a0be-eee92b188fa4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1709 microversion: 2.1 time: 0.226736 Jul 26 05:02:50.727915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 143/309] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:50 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1709 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:50.846258 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:50.846969 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:50.865937 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.867772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:50.876479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:50.879102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:51.061601 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:51.070590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:51.076244 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:51.077785 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-94ee1ba3-e5bf-41e8-a29e-a5ddc23e76a5 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.236751 Jul 26 05:02:51.094386 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 167/310] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:50 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:51.484968 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:51.485647 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:51.494883 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:51.495670 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:51.497338 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:51.498028 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:51.730338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:51.731264 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:51.738488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:51.738930 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:51.739775 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:51.740204 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:51.856666 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:51.866887 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ae7e45c3-ed68-4882-ab05-e75e7b7fc97d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1509 microversion: 2.1 time: 0.387443 Jul 26 05:02:51.880304 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 144/311] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:51 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:51.968900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:51.978595 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8722820c-eac0-4a38-a8fc-292d9a9e7aba tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1709 microversion: 2.1 time: 0.252110 Jul 26 05:02:51.979823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 168/312] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:51 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1709 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:52.102275 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:52.102951 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:52.113179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:52.113618 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:52.114385 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:52.114806 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:52.299993 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:52.311192 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:52.312830 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:52.314126 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-46cd70bc-fa64-4e21-bd97-9b5b1f14530e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.216753 Jul 26 05:02:52.338294 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 145/313] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:52 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:02:52.913466 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:52.914706 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:52.923666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:52.924493 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:52.925501 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:52.925925 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:53.000743 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:53.001917 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:53.012594 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:53.014111 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:53.015588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:53.024891 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:53.118756 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:53.125817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:53.130554 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9c179399-ae03-48f8-bb87-903c9a40296c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1509 microversion: 2.1 time: 0.233382 Jul 26 05:02:53.132527 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 169/314] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:52 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:53.218124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:53.228952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0f84b5a6-decc-44c1-ac0c-bfa13ab35d1b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1709 microversion: 2.1 time: 0.232043 Jul 26 05:02:53.244338 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 146/315] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:52 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1709 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:02:53.339983 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:53.340584 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:53.353621 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:53.354089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:53.354846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:53.355306 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:53.706672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:53.719976 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:53.721839 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:53.723179 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c74484a2-3e5f-4cec-a5f7-401ba1546d51 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.389704 Jul 26 05:02:53.723855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 170/316] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:53 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:54.159922 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:54.161497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:54.168602 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.169518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.170765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.171413 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.256070 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:54.258717 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:54.269032 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.270081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.271090 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.271770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.378806 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:54.400402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b52a84a2-ebc7-4ec4-8010-50aed1f6812e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1509 microversion: 2.1 time: 0.247075 Jul 26 05:02:54.401189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 147/317] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:54 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:54.451347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:54.460141 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5f36b53e-415b-4065-9578-399196cbc0e3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1709 microversion: 2.1 time: 0.209851 Jul 26 05:02:54.460653 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 171/318] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:54 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1709 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:54.748737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:54.749344 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:54.764232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.767485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.769154 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:54.770163 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:54.944588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:54.953741 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:54.955650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:54.957114 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d051efb1-484b-495f-ad0e-e4e64f2f94a4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.212902 Jul 26 05:02:54.958224 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 148/319] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:54 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:55.422288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:55.422897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:55.432586 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:55.433371 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:55.434292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:55.435015 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:55.482167 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:55.482950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:55.493474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:55.494091 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:55.494969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:55.495493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:55.651584 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:55.660484 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-69e67c1c-be86-47f9-8456-8b7435a62cc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1509 microversion: 2.1 time: 0.242260 Jul 26 05:02:55.661665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 172/320] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:55 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:55.678961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:55.688459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-78bede9d-2e60-4854-820f-6a09284ee12b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1709 microversion: 2.1 time: 0.210875 Jul 26 05:02:55.689675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 149/321] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:55 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1709 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:55.987365 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:55.988290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:55.999616 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.000368 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.002631 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.003314 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.400505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:56.412497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:56.414409 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:56.415654 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3c5d9f3b-ec7a-4146-9ef6-df89514a543d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.433212 Jul 26 05:02:56.416423 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 173/322] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:55 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:02:56.685372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:56.687159 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:56.695938 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.697050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.697846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.698263 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.701606 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:02:56.712176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:56.714601 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:56.726833 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.727285 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:56.728176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:56.732310 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.000002 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:57.008108 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e6cbf507-e081-426c-87d4-88175b54785a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1515 microversion: 2.1 time: 0.327445 Jul 26 05:02:57.010615 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 150/323] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:56 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1515 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:57.022481 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:57.045051 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3b17a96c-7fa5-469d-b220-0bc74c611a67 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1709 microversion: 2.1 time: 0.338404 Jul 26 05:02:57.047909 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 174/324] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:56 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1709 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:57.441568 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:57.444567 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:57.454050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:57.458229 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.459054 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:57.459497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:57.706590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:57.721143 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:57.722736 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:57.724180 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bbdbb8f4-b450-4934-85fd-2c222e1554d4 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.286957 Jul 26 05:02:57.724919 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 151/325] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:57 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:02:58.066406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:58.067790 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:58.080549 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.080999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.081788 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.082217 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.478737 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:58.501116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-de28e281-7034-4905-85f4-fb8849ffbc3a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1713 microversion: 2.1 time: 0.436854 Jul 26 05:02:58.502505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 175/326] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:02:58 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1713 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:02:58.604141 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7749b449-90f6-4164-a3bb-9ced08a69395 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'create', calling method: .version_select at 0x7f0e95373dc0>, body: {"keypair": {"name": "tempest-keypair-2043573485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBbLDJcdEBI1zNVzHiAvhqnTlhR+seZ7Zi1dRRoAS8xu5PSpI+RvrOkR5JyEDUhI1O2z6qjLGUQOoW52+YzwE5QYRwJVQ6JIatJMB7Q/suCtoDaXLQHe4f2cQgjx8sbWA=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:02:58.643268 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-7749b449-90f6-4164-a3bb-9ced08a69395 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for project 1c772e5c90114978ad92818d58ca11c2. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:02:58.658069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-7749b449-90f6-4164-a3bb-9ced08a69395 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for user f0cc1af7d7d642889a1a11103f087e79 and project 1c772e5c90114978ad92818d58ca11c2. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:02:58.713920 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7749b449-90f6-4164-a3bb-9ced08a69395 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114216 Jul 26 05:02:58.718460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 152/327] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:02:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:02:58.748643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:02:58.749512 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:02:58.761265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.761931 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:58.769213 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:02:58.770798 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:02:59.099057 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:59.109199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:59.111789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:02:59.114839 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55b59679-9041-448e-90f0-ac9d2d376550 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.370626 Jul 26 05:02:59.126981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 176/328] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:02:58 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:00.153828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:00.156323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:00.185504 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:00.186785 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:00.190279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:00.191224 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:00.595996 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:00.611753 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:00.614317 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:00.615907 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-877c2179-8678-49fe-bf07-34068a8cc829 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.476330 Jul 26 05:03:00.616747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 153/329] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:00 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:01.416965 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-162105960", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94dd837e-81c9-4e2e-9135-742712cb9531"}], "security_groups": [{"name": "tempest-securitygroup--1561527460"}], "key_name": "tempest-keypair-2043573485", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:01.538596 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] validate_networks() for [('94dd837e-81c9-4e2e-9135-742712cb9531', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:03:01.640863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:01.642067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:01.649384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.650241 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.651317 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:01.652146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:01.946926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:01.963021 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:01.966908 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:01.969629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4622d0e8-39a7-4cc2-9654-0a4a0f52f6ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1738 microversion: 2.20 time: 0.332986 Jul 26 05:03:01.970585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 154/330] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:01 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:03:02.246912 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:03:02.247399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:03:02.247999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:03:02.249318 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:03:02.249949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:03:02.262891 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:02.263332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:02.264172 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:02.264792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:02.285675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for project 1c772e5c90114978ad92818d58ca11c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:03:02.290514 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Getting quotas for user f0cc1af7d7d642889a1a11103f087e79 and project 1c772e5c90114978ad92818d58ca11c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:03:02.304415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:03:02.307012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:03:02.368409 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5fae9836-8ef8-4a9f-a3fb-4005ebd20882 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.955988 Jul 26 05:03:02.369411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 177/331] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:03:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 05:03:02.381599 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-54f13acb-9c97-48f8-9806-bdce25567e2c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:02.382203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-54f13acb-9c97-48f8-9806-bdce25567e2c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:02.485623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-54f13acb-9c97-48f8-9806-bdce25567e2c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:02.495280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-54f13acb-9c97-48f8-9806-bdce25567e2c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1245 microversion: 2.1 time: 0.118536 Jul 26 05:03:02.496710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 155/332] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:02 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:02.994872 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:02.995759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:03.003578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.004140 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.005003 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.005633 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.332533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:03.346501 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:03.348110 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:03.349329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-daab5ccb-37c4-4d14-ba3a-a49293931162 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1720 microversion: 2.20 time: 0.359369 Jul 26 05:03:03.350054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 178/333] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:02 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1720 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:03.529701 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:03.530786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:03.543329 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.544136 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.545501 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:03.546237 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:03.690484 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:03.701341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2a94f710-7383-491b-8b9b-2323e5aa4467 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1249 microversion: 2.1 time: 0.179641 Jul 26 05:03:03.701955 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 156/334] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:03 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1249 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:04.377757 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:04.378481 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:04.391387 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:04.392211 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:04.395256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:04.395734 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:04.683670 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:04.693609 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:04.698087 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:04.698826 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a84f90c3-9d59-405f-8db1-ae80fed0788a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1720 microversion: 2.20 time: 0.328724 Jul 26 05:03:04.703768 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 179/335] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:04 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1720 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:04.733068 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:04.733681 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:04.743580 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:04.744327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:04.745346 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:04.746673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:04.907384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:04.918401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-169e9c70-7d66-45e3-b3a1-2c8ab175ccd0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1241 microversion: 2.1 time: 0.188511 Jul 26 05:03:04.919391 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 157/336] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:04 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1241 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:05.728378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:05.730548 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:05.738649 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.739327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.740507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.741396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.828667 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-c6f4ee8e-9333-4df0-b661-a163dd51a237 req-4a14f27f-032d-4f8c-b54a-aa5371dd7bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b3bcc1-fe56-4edd-b25a-a2c338610939", "name": "network-vif-unplugged", "status": "completed", "tag": "a540d166-7fe8-4084-911e-a2037b5f9fd5"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:05.854749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-c6f4ee8e-9333-4df0-b661-a163dd51a237 req-4a14f27f-032d-4f8c-b54a-aa5371dd7bbe service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.861084 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-c6f4ee8e-9333-4df0-b661-a163dd51a237 req-4a14f27f-032d-4f8c-b54a-aa5371dd7bbe service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.884459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-c6f4ee8e-9333-4df0-b661-a163dd51a237 req-4a14f27f-032d-4f8c-b54a-aa5371dd7bbe service nova] Creating event network-vif-unplugged:a540d166-7fe8-4084-911e-a2037b5f9fd5 for instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 on hv-cinder-85057 Jul 26 05:03:05.896070 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-c6f4ee8e-9333-4df0-b661-a163dd51a237 req-4a14f27f-032d-4f8c-b54a-aa5371dd7bbe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071147 Jul 26 05:03:05.897842 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 158/337] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:03:05.944522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:05.945553 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:05.965557 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.966029 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.966851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:05.967299 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:05.988311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:06.006170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:06.008068 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:06.012116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-116b6310-bc63-4813-85fb-214106bad5bb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1723 microversion: 2.20 time: 0.287983 Jul 26 05:03:06.019136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 180/338] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:05 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:06.043070 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-379a5e3a-9947-4071-b6ce-00bc9c0247e8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c440fd9f-b4af-4fc1-a2c9-eda1c70104f8"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:06.045706 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-379a5e3a-9947-4071-b6ce-00bc9c0247e8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:06.051335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:06.054146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-379a5e3a-9947-4071-b6ce-00bc9c0247e8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.054630 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-379a5e3a-9947-4071-b6ce-00bc9c0247e8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.055995 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-379a5e3a-9947-4071-b6ce-00bc9c0247e8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.056618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-379a5e3a-9947-4071-b6ce-00bc9c0247e8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.062084 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bdff7a99-a624-4aa0-b5dd-628aac1ab183 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1297 microversion: 2.1 time: 0.125431 Jul 26 05:03:06.072471 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 159/339] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:05 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:06.530510 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-379a5e3a-9947-4071-b6ce-00bc9c0247e8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.491870 Jul 26 05:03:06.531137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 181/340] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Jul 26 05:03:06 2022] POST /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments => generated 188 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:03:06.666637 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d9e0e134-b314-445f-aeb4-1c38ef3446a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:06.667339 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d9e0e134-b314-445f-aeb4-1c38ef3446a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:06.675809 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9e0e134-b314-445f-aeb4-1c38ef3446a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.676772 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9e0e134-b314-445f-aeb4-1c38ef3446a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.678186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9e0e134-b314-445f-aeb4-1c38ef3446a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.679180 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9e0e134-b314-445f-aeb4-1c38ef3446a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.815144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d9e0e134-b314-445f-aeb4-1c38ef3446a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/action" status: 202 len: 0 microversion: 2.20 time: 0.152658 Jul 26 05:03:06.816117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 160/341] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Jul 26 05:03:06 2022] POST /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:03:06.828745 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:06.829963 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:06.841075 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.841757 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:06.843041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:06.843668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:07.085580 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:07.086208 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:07.093768 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:07.094745 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:07.095897 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:07.096491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:07.166526 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:07.182532 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:07.184573 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:07.185794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-29b4fcd6-a6c3-4258-bf82-5f27bfafe04f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1749 microversion: 2.20 time: 0.361924 Jul 26 05:03:07.212095 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 182/342] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:06 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1749 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:03:07.340017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:07.352378 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-74e7cc19-c89b-49f3-b263-a2424e1830a9 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1303 microversion: 2.1 time: 0.272692 Jul 26 05:03:07.352999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 161/343] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:07 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1303 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:08.220590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:08.222130 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:08.237311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:08.238082 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:08.242251 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:08.242956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:08.376866 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:08.377660 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:08.396196 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:08.396659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:08.397457 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:08.397874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:09.183975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:09.201954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-60537007-3ba1-4e86-a093-1fa702d1350c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.826702 Jul 26 05:03:09.203734 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 162/344] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:08 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:09.211273 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:09.250592 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:09.262658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:09.270439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8ae7e5ec-330a-4738-b56a-03d19c7c9a8b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1749 microversion: 2.20 time: 1.050485 Jul 26 05:03:09.280123 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 183/345] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:08 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1749 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:10.011086 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-fe04fbdf-44a1-4cca-bf52-61e7fadab993 req-3db1cd82-2012-4af1-89ca-28e16fcaf03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ea2890-2edd-445f-a103-85febb5cee98", "tag": "d1799624-13c2-451d-96a9-a79751ea030c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:10.041035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fe04fbdf-44a1-4cca-bf52-61e7fadab993 req-3db1cd82-2012-4af1-89ca-28e16fcaf03c service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.041473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fe04fbdf-44a1-4cca-bf52-61e7fadab993 req-3db1cd82-2012-4af1-89ca-28e16fcaf03c service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.101729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-fe04fbdf-44a1-4cca-bf52-61e7fadab993 req-3db1cd82-2012-4af1-89ca-28e16fcaf03c service nova] Creating event network-changed:d1799624-13c2-451d-96a9-a79751ea030c for instance d8ea2890-2edd-445f-a103-85febb5cee98 on hv-cinder-85057 Jul 26 05:03:10.109894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-fe04fbdf-44a1-4cca-bf52-61e7fadab993 req-3db1cd82-2012-4af1-89ca-28e16fcaf03c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104228 Jul 26 05:03:10.119627 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 163/346] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:10.228644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:10.229769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:10.250840 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.252394 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.255238 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.258271 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.296109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:10.296817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:10.309868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.310312 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.311111 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:10.311541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:10.349304 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:10.841269 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:10.854775 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:10.861896 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:10.863214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f40d25c2-6343-4c78-9e8e-6018030774ce tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1751 microversion: 2.20 time: 0.571913 Jul 26 05:03:10.864174 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 164/347] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:10 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1751 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:03:10.875229 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:10.884230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3f7b9f9a-3deb-440d-9bf5-002d8a5294e5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.659482 Jul 26 05:03:10.885438 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 184/348] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:10 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:11.892396 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:11.893286 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:11.901004 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:11.908170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:11.909455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:11.923525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:11.927297 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:11.928358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:11.929317 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:11.929880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:11.930453 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:11.935387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:11.936199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:12.256787 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:12.267474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:12.268981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8bf8c763-afbb-4b8e-a3f5-92707a3bcfb5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.366119 Jul 26 05:03:12.269818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 185/349] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:11 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:12.297326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:12.307316 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:12.309094 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-961864c9-67d6-4c48-aca6-29e6f20b5efb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.424880 Jul 26 05:03:12.310176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 165/350] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:11 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:13.300899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:13.302235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:13.309277 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:13.310003 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:13.312570 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.313347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:13.314300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.315336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:13.338046 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:13.339545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:13.346069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:13.349455 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.350130 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:13.351265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:13.351911 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:13.703076 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:13.714957 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-22761c3a-88e5-4c7f-a09f-88bbef88de8c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.428217 Jul 26 05:03:13.734922 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 186/351] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:13 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:13.872073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:13.907161 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:13.908502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:13.928311 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-209400aa-569f-4cea-b61d-60c27b2162ad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.595034 Jul 26 05:03:13.943589 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 166/352] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:13 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:14.740847 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:14.741714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:14.755121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:14.758145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:14.760850 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:14.764351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:15.036888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:15.045261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-02dd335c-e9e5-4d41-be2e-e9a67e3a939c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.310004 Jul 26 05:03:15.046491 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 187/353] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:14 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:15.052014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:15.052917 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:15.062812 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:15.063512 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:15.064536 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:15.065179 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:15.262408 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ca708b1-2021-491c-ae20-334d286c86d5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Action: 'create', calling method: .version_select at 0x7f0e9533fee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-650642350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6xAu/Hmaon4N+Y19XteXKlkvvG+Z98Ld6879YmZXvTJNT3i6PWx8J0+YnxVOzycZH+OJPO91XowIM5wGSMBifIGmR/AsOdPBqZNb3seUqYXNPk5vid0c5riP/g76JGlA=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:15.282087 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-4ca708b1-2021-491c-ae20-334d286c86d5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for project 987757bb89e64419822e021b15a65c31. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:03:15.287016 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-4ca708b1-2021-491c-ae20-334d286c86d5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for user 148ea5a9b7a74172b290696be99aa5c1 and project 987757bb89e64419822e021b15a65c31. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:03:15.319657 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4ca708b1-2021-491c-ae20-334d286c86d5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.427949 Jul 26 05:03:15.322358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 167/354] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:03:14 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:15.431655 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:15.446590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:15.448210 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:15.449425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d668bbde-8f67-4ff0-9ad7-105540f34ee1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.401705 Jul 26 05:03:15.455495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 188/355] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:15 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:15.934451 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-95f4eab5-c2e1-47a5-ac25-a2e69f2c5fe1 req-fdca695b-683c-4c42-9d0d-5bb06c869d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ea2890-2edd-445f-a103-85febb5cee98", "name": "network-vif-plugged", "status": "completed", "tag": "d1799624-13c2-451d-96a9-a79751ea030c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:15.971490 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-95f4eab5-c2e1-47a5-ac25-a2e69f2c5fe1 req-fdca695b-683c-4c42-9d0d-5bb06c869d7a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:15.977714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-95f4eab5-c2e1-47a5-ac25-a2e69f2c5fe1 req-fdca695b-683c-4c42-9d0d-5bb06c869d7a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.021443 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-95f4eab5-c2e1-47a5-ac25-a2e69f2c5fe1 req-fdca695b-683c-4c42-9d0d-5bb06c869d7a service nova] Creating event network-vif-plugged:d1799624-13c2-451d-96a9-a79751ea030c for instance d8ea2890-2edd-445f-a103-85febb5cee98 on hv-cinder-85057 Jul 26 05:03:16.050538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-95f4eab5-c2e1-47a5-ac25-a2e69f2c5fe1 req-fdca695b-683c-4c42-9d0d-5bb06c869d7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121645 Jul 26 05:03:16.053132 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 168/356] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:16.066730 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:16.068122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:16.083500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.084451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.087518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.088465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.357750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:16.368005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-93c20d12-2786-42d1-9b73-068b63a14bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.305303 Jul 26 05:03:16.393203 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 189/357] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:16 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:16.486726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:16.487437 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:16.508953 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.509394 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.510181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:16.510653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:16.802537 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:16.826778 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:16.828882 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:16.830465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2f30e73d-78bd-47ea-b7f8-ba132bd54f3a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.353434 Jul 26 05:03:16.839433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 169/358] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:16 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:17.403499 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:17.404257 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:17.438990 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:17.449060 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:17.450029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:17.451117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:17.451976 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:17.771091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:17.782497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5271e1eb-f9cb-4dbc-8570-40d5ddfd4c33 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.389563 Jul 26 05:03:17.801893 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 190/359] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:17 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:17.857441 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:17.858995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:17.879649 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:17.882309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:17.883386 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:17.886123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:18.281053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:18.294475 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:18.307779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:18.314280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:18.316201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-70f09418-1016-4310-99d4-cab453561cf2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.463104 Jul 26 05:03:18.319963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 170/360] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:17 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:18.811675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:18.813613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:18.829362 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:18.829718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:18.830513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:18.830946 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:19.174034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:19.185447 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c3866a7-ebfa-44b7-aaeb-e60466e96b25 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.378882 Jul 26 05:03:19.200370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 191/361] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:18 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:19.345757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:19.347342 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:19.356987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:19.358428 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:19.359488 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:19.360177 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:19.601390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:19.624609 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:19.629527 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:19.636238 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ece32d36-08a7-47e2-b3f2-13dffe22fe5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.294569 Jul 26 05:03:19.643987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 171/362] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:19 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:20.220009 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:20.222415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:20.233824 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.234562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.236555 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.237889 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.461545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:20.470539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-11eec13a-00a2-4b31-9aeb-107d5a3424ee tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.259094 Jul 26 05:03:20.471583 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 192/363] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:20 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:20.662718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:20.663382 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:20.670475 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.670913 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.671750 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:20.672221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:20.894962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:20.911545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:20.913281 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:20.914901 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6fff89e5-3367-4918-8015-3b1f3942985e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.256184 Jul 26 05:03:20.916034 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 172/364] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:20 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:21.495323 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:21.496255 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:21.504473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:21.505350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:21.506266 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:21.506778 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:21.665011 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:21.676226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3cd9efaf-902f-4a06-b455-f3731471d439 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.186663 Jul 26 05:03:21.687121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 193/365] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:21 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:21.940495 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:21.941921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:21.950403 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:21.951260 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:21.952327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:21.953016 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:22.116278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:22.128042 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:22.130062 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:22.131338 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-879530d7-a4bb-4cd2-ada9-0aa4a47f4e98 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.196002 Jul 26 05:03:22.132236 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 173/366] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:21 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:22.702909 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:22.703811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:22.710847 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:22.711288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:22.712107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:22.712537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:22.860855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:22.869459 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-23c41d11-df4d-4ba9-889c-781fc42027c7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.170633 Jul 26 05:03:22.870488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 194/367] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:22 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:23.155829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:23.156503 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:23.163853 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:23.164574 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:23.165340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:23.165763 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:23.337655 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:23.350970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:23.353113 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:23.355655 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-978f89fd-a38e-44e1-82df-54670cd6287c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.204367 Jul 26 05:03:23.356676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 174/368] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:23 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:23.890979 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:23.891666 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:23.899399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:23.899894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:23.901034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:23.901470 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:24.068009 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:24.077148 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c1259c3-51c9-4b70-9e51-31b63057b737 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.190255 Jul 26 05:03:24.077640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 195/369] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:23 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:24.380371 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:24.382044 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:24.390605 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:24.391576 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:24.394994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:24.395089 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:24.536452 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:24.546505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:24.548071 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:24.549295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-da763c56-b2c9-4d8c-9341-a3ac1da8c8ac tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.173529 Jul 26 05:03:24.549889 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 175/370] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:24 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:25.098498 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:25.099060 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:25.106467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:25.106943 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:25.107852 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:25.108299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:25.261660 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:25.271164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0eda4e46-edf6-40c4-86b6-83e216250771 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.175847 Jul 26 05:03:25.272460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 196/371] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:25 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:25.576011 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:25.576666 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:25.578626 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=4 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:25.587125 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:25.587586 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:25.588767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:25.589188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:25.743698 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:25.752980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:25.754501 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:25.755708 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-77751c5b-b48d-4760-81f3-0f9a26624492 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.184910 Jul 26 05:03:25.756304 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 176/372] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:25 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:26.292659 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:26.293252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:26.300814 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:26.301259 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:26.302529 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:26.302959 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:26.441725 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:26.449825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a3c9c690-1289-4ec4-b075-aa9fe6bee13b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1371 microversion: 2.1 time: 0.161091 Jul 26 05:03:26.450389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 197/373] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:26 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:26.781626 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:26.782201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:26.791413 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:26.791932 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:26.792723 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:26.793194 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:26.942053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:26.954460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:26.956127 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:26.957372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-944a5570-16ea-4db7-ac25-74d798f2786e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.181547 Jul 26 05:03:26.958063 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 177/374] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:26 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:27.471494 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:27.472773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:27.480889 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:27.481343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:27.482119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:27.482552 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:27.627140 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:27.635539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5e1fa118-9f8e-49f3-ba52-451f952e2dc5 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1565 microversion: 2.1 time: 0.167904 Jul 26 05:03:27.636134 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 198/375] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:27 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:27.656796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ae47c3c2-3e02-4b59-a016-d335fa7b10da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:27.657205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ae47c3c2-3e02-4b59-a016-d335fa7b10da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:27.663591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae47c3c2-3e02-4b59-a016-d335fa7b10da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:27.664086 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae47c3c2-3e02-4b59-a016-d335fa7b10da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:27.664875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae47c3c2-3e02-4b59-a016-d335fa7b10da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:27.665300 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae47c3c2-3e02-4b59-a016-d335fa7b10da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:27.748217 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ae47c3c2-3e02-4b59-a016-d335fa7b10da tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095652 Jul 26 05:03:27.748814 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 178/376] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:03:27 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:27.981693 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:27.982475 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:27.989898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:27.990331 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:27.991085 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:27.991504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:28.356535 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:28.367969 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:28.369506 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:28.370698 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-43be1f9a-a652-43bb-ac40-ffddf7f3df3d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.394029 Jul 26 05:03:28.371494 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 199/377] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:27 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:29.238345 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-9cb5ee24-7a01-48a9-8eaa-0f9d4217944a req-73230579-c532-4c6d-8e00-aa607756e929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ea2890-2edd-445f-a103-85febb5cee98", "tag": "d1799624-13c2-451d-96a9-a79751ea030c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:29.260713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9cb5ee24-7a01-48a9-8eaa-0f9d4217944a req-73230579-c532-4c6d-8e00-aa607756e929 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:29.261231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9cb5ee24-7a01-48a9-8eaa-0f9d4217944a req-73230579-c532-4c6d-8e00-aa607756e929 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:29.273092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-9cb5ee24-7a01-48a9-8eaa-0f9d4217944a req-73230579-c532-4c6d-8e00-aa607756e929 service nova] Creating event network-changed:d1799624-13c2-451d-96a9-a79751ea030c for instance d8ea2890-2edd-445f-a103-85febb5cee98 on hv-cinder-85057 Jul 26 05:03:29.279273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-9cb5ee24-7a01-48a9-8eaa-0f9d4217944a req-73230579-c532-4c6d-8e00-aa607756e929 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047457 Jul 26 05:03:29.280238 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 179/378] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:29.398935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:29.399546 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:29.407637 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:29.408406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:29.409376 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:29.409976 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:29.621147 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:29.630177 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:29.631755 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:29.632960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-494986fd-6349-4568-baa9-c6510febee8a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.241888 Jul 26 05:03:29.633698 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 200/379] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:29 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:30.659431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:30.660346 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:30.668979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:30.669423 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:30.670191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:30.670623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:30.807162 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:30.818209 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:30.820751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:30.822449 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bc7f2315-4b17-4c59-a2c2-49f507d03408 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.168659 Jul 26 05:03:30.823181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 180/380] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:30 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:31.851682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:31.852247 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:31.859450 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:31.859918 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:31.860676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:31.861102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:31.865073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:32.004717 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:32.013851 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:32.015371 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:32.016571 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-64e4cda6-6567-4937-9d50-2f4406f88edc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.169084 Jul 26 05:03:32.017183 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 201/381] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:31 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:33.040904 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:33.041485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:33.048475 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:33.048922 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:33.049691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:33.050125 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:33.191092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:33.203676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:33.205239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:33.206372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-be2a2f64-ca65-4c04-86fa-e976dfe4c20b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.169616 Jul 26 05:03:33.206889 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 181/382] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:33 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:34.236338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:34.236994 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:34.246648 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:34.247099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:34.248199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:34.248831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:34.389460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:34.398411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:34.400039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:34.401249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a7eddfb3-c6d6-4c1c-a69f-ef4b36008732 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.171240 Jul 26 05:03:34.401842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 202/383] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:34 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:34.675628 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2111050138", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-650642350", "security_groups": [{"name": "tempest-secgroup-smoke-2144158790"}], "block_device_mapping_v2": [{"uuid": "c1c5b4f8-f1e2-4b5e-9714-1b81b89f2386", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51ac167e-d2d0-4324-aecb-2b52bb6a1ed2"}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:34.796348 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] validate_networks() for [('51ac167e-d2d0-4324-aecb-2b52bb6a1ed2', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:03:35.231163 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:03:35.231735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:03:35.232343 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:03:35.232886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:03:35.233401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:03:35.244766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:35.245309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:35.246348 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:35.246775 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:35.264334 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for project 987757bb89e64419822e021b15a65c31. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:03:35.268395 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for user 148ea5a9b7a74172b290696be99aa5c1 and project 987757bb89e64419822e021b15a65c31. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:03:35.331148 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:03:35.334009 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1c5b4f8-f1e2-4b5e-9714-1b81b89f2386',volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:03:35.425358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:35.425962 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:35.432832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:35.433376 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:35.434153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:35.434600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:35.477116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b69ff1fc-a29b-44c3-9534-f0c75b6ed509 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805355 Jul 26 05:03:35.478263 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 182/384] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:03:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:03:35.488913 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-78c1a165-57d5-41a9-a47a-aec92ad3ea62 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:35.490176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-78c1a165-57d5-41a9-a47a-aec92ad3ea62 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:35.558953 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-78c1a165-57d5-41a9-a47a-aec92ad3ea62 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:35.567875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-78c1a165-57d5-41a9-a47a-aec92ad3ea62 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1094 microversion: 2.1 time: 0.082516 Jul 26 05:03:35.581333 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 183/385] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:35 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:03:35.596081 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-605bef90-e425-4e84-8a87-0d6ef5301aae req-23dcc5b5-d792-40d4-8586-1165dcbfaf15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b3bcc1-fe56-4edd-b25a-a2c338610939", "name": "network-vif-plugged", "status": "completed", "tag": "a540d166-7fe8-4084-911e-a2037b5f9fd5"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:35.607393 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-605bef90-e425-4e84-8a87-0d6ef5301aae req-23dcc5b5-d792-40d4-8586-1165dcbfaf15 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:35.608323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-605bef90-e425-4e84-8a87-0d6ef5301aae req-23dcc5b5-d792-40d4-8586-1165dcbfaf15 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:35.622632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-605bef90-e425-4e84-8a87-0d6ef5301aae req-23dcc5b5-d792-40d4-8586-1165dcbfaf15 service nova] Creating event network-vif-plugged:a540d166-7fe8-4084-911e-a2037b5f9fd5 for instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 on hv-cinder-85057 Jul 26 05:03:35.625584 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:35.630751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-605bef90-e425-4e84-8a87-0d6ef5301aae req-23dcc5b5-d792-40d4-8586-1165dcbfaf15 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038769 Jul 26 05:03:35.631751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 184/386] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:03:35.635402 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:35.637145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:35.638496 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18c39ed0-b659-4229-a0e5-5aa93e38b7ef tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.216931 Jul 26 05:03:35.639102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 203/387] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:35 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:36.589028 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:36.589633 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:36.596532 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:36.596973 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:36.597725 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:36.598150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:36.662286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:36.662929 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:36.663350 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:36.669842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:36.670279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:36.671048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:36.671256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-94c6b96e-7f25-453f-8f2b-a04fe30331c5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1192 microversion: 2.1 time: 0.086583 Jul 26 05:03:36.671481 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:36.671884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 185/388] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:36 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:36.816179 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:36.825800 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:36.827281 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:36.828481 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-73fb986b-c298-4b8e-9fe1-1fd08a95f304 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.170222 Jul 26 05:03:36.829042 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 204/389] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:36 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:37.697752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:37.698608 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:37.709662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:37.710363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:37.711719 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:37.712438 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:37.791760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:37.799942 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5ecc420c-757d-4b4d-a294-22bc9d8329a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1210 microversion: 2.1 time: 0.109489 Jul 26 05:03:37.800555 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 186/390] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:37 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:37.854169 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:37.854783 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:37.862607 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:37.863053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:37.863843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:37.864267 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:38.011434 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:38.020301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:38.021823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:38.022969 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-209157f0-1013-4d19-894d-9a368af3a5cb tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.172724 Jul 26 05:03:38.023528 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 205/391] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:37 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:38.822022 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:38.823247 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:38.830653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:38.831329 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:38.832214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:38.833179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.053012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:39.054675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:39.055280 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:39.062641 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d972b7d5-71df-4bde-afe9-1ef50d7727ca tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1278 microversion: 2.1 time: 0.245222 Jul 26 05:03:39.068810 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 187/392] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:38 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:39.070382 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:39.070834 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.071652 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:39.072112 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.300894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:39.310661 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:39.312442 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:39.313604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ec7a963f-7636-47c6-a0bb-067e642c538b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1807 microversion: 2.20 time: 0.262845 Jul 26 05:03:39.314158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 206/393] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:39 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:03:39.833410 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-2a1deb35-9cd0-4c30-a4c8-93a6fb98493c req-3d54aa1f-fa35-44e4-8ea0-f82bee693016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d72962b6-f3c4-41b4-96fd-5045b03faf2a", "tag": "6cf9eff0-8091-47a1-b175-0369e3eb4648"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:39.845997 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2a1deb35-9cd0-4c30-a4c8-93a6fb98493c req-3d54aa1f-fa35-44e4-8ea0-f82bee693016 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:39.846494 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2a1deb35-9cd0-4c30-a4c8-93a6fb98493c req-3d54aa1f-fa35-44e4-8ea0-f82bee693016 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:39.858626 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-2a1deb35-9cd0-4c30-a4c8-93a6fb98493c req-3d54aa1f-fa35-44e4-8ea0-f82bee693016 service nova] Creating event network-changed:6cf9eff0-8091-47a1-b175-0369e3eb4648 for instance d72962b6-f3c4-41b4-96fd-5045b03faf2a on hv-cinder-85057 Jul 26 05:03:39.863579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-2a1deb35-9cd0-4c30-a4c8-93a6fb98493c req-3d54aa1f-fa35-44e4-8ea0-f82bee693016 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034204 Jul 26 05:03:39.864425 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 188/394] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:40.089660 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:40.090432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:40.098149 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:40.098594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:40.099366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:40.099822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:40.301663 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:40.310007 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e7bbd2ed-f461-4ac7-a7a7-03431f077064 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.224610 Jul 26 05:03:40.310596 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 207/395] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:40 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:40.338532 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:40.339298 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:40.348045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:40.348526 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:40.349287 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:40.349714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:40.494437 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:40.503866 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:40.505365 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:40.506829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5be000c2-3878-4535-b78a-4ffc05b65000 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1794 microversion: 2.20 time: 0.172604 Jul 26 05:03:40.507364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 189/396] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:03:40 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:03:41.332054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:41.332635 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:41.339768 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:41.340351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:41.341120 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:41.341540 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:41.617492 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:41.626062 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-acd344dd-86db-4ab5-8482-671ffd4362c9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.297788 Jul 26 05:03:41.626718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 208/397] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:41 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:42.655892 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:42.656428 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:42.658891 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:42.664663 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:42.665107 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:42.665876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:42.666307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:42.815502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:42.824052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d4c6a994-9863-432b-99cb-2f649eca9c8e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.174700 Jul 26 05:03:42.824623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 190/398] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:42 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:43.845475 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:43.846019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:43.852949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:43.853389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:43.854158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:43.854586 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:43.998569 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:44.006625 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-212d99e4-1824-49e4-8c9d-bae40eff8063 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.165171 Jul 26 05:03:44.007186 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 209/399] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:43 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:45.033295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:45.033904 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:45.040762 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:45.041203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:45.041971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:45.042394 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:45.058038 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:45.192405 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:45.204479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fb96b5de-a850-4d6c-a3b7-91ba88b3af48 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.176582 Jul 26 05:03:45.205004 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 191/400] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:45 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:46.227216 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:46.228135 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:46.237422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:46.237870 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:46.238630 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:46.239079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:46.378095 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:46.386096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-88934d2d-0489-4d35-89de-1b7fe7e37252 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.164160 Jul 26 05:03:46.386665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 210/401] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:46 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:46.729737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:46.730545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:46.733191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:46.734231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=8 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:46.741636 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:46.742078 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:46.742861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:46.743282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:46.881449 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lazy-loading 'services' on Instance uuid 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:03:47.012226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d43c4283-086c-4e43-ae43-9455e2e737b8 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-volume_attachments/2aefce1c-a9bd-4c80-871e-4e2050de8347" status: 202 len: 0 microversion: 2.1 time: 0.288431 Jul 26 05:03:47.012905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 192/402] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:03:46 2022] DELETE /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-volume_attachments/2aefce1c-a9bd-4c80-871e-4e2050de8347 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:03:47.406939 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:47.407430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:47.414304 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:47.414751 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:47.415517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:47.415998 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:47.559140 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:47.567619 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2ffb2897-8f22-4bdb-ad98-abb5f0b09901 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.164701 Jul 26 05:03:47.575860 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 211/403] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:47 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:48.152384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d5c8f8d1-2092-4efa-9e39-8bd86d644557 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:48.158889 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d5c8f8d1-2092-4efa-9e39-8bd86d644557 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:48.159332 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d5c8f8d1-2092-4efa-9e39-8bd86d644557 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:48.181720 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d5c8f8d1-2092-4efa-9e39-8bd86d644557 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Going to try to stop instance {{(pid=117993) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 05:03:48.236151 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d5c8f8d1-2092-4efa-9e39-8bd86d644557 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action" status: 202 len: 0 microversion: 2.1 time: 0.088311 Jul 26 05:03:48.236863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 193/404] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:03:48 2022] POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:03:48.245640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:48.246244 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:48.251726 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=44 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:48.253481 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:48.253927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:48.254687 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:48.255116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:48.391622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:48.400558 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1231ac22-d83e-405b-abaf-1c4b345117cf tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.158901 Jul 26 05:03:48.401141 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 212/405] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:48 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:48.589938 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:48.590666 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:48.597953 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:48.598399 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:48.599165 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:48.599599 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:48.742348 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:48.753139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aa3307f7-b4bf-4089-b628-e5d42cfee3db tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.167517 Jul 26 05:03:48.753716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 194/406] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:48 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:49.421918 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:49.422529 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:49.429904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:49.430360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:49.431110 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:49.431536 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:49.563648 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:49.572235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5942fd8e-933f-4c87-b035-572cdcffd2c1 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.154312 Jul 26 05:03:49.573028 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 213/407] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:49 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:49.653708 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-8f006843-5197-4f5d-9c71-5f2e5906fcf6 req-e4a16783-b1fb-43fa-be73-73a0b9e6eb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72962b6-f3c4-41b4-96fd-5045b03faf2a", "name": "network-vif-plugged", "status": "completed", "tag": "6cf9eff0-8091-47a1-b175-0369e3eb4648"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:49.664263 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8f006843-5197-4f5d-9c71-5f2e5906fcf6 req-e4a16783-b1fb-43fa-be73-73a0b9e6eb97 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:49.664694 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8f006843-5197-4f5d-9c71-5f2e5906fcf6 req-e4a16783-b1fb-43fa-be73-73a0b9e6eb97 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:49.676905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-8f006843-5197-4f5d-9c71-5f2e5906fcf6 req-e4a16783-b1fb-43fa-be73-73a0b9e6eb97 service nova] Creating event network-vif-plugged:6cf9eff0-8091-47a1-b175-0369e3eb4648 for instance d72962b6-f3c4-41b4-96fd-5045b03faf2a on hv-cinder-85057 Jul 26 05:03:49.681985 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-8f006843-5197-4f5d-9c71-5f2e5906fcf6 req-e4a16783-b1fb-43fa-be73-73a0b9e6eb97 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Jul 26 05:03:49.682566 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 195/408] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:03:49.774350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:49.774960 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:49.782720 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:49.783339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:49.784419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:49.785099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:49.930037 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:49.937906 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-33f6ddff-5b4b-4ba1-8496-24b230977c4d tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.167494 Jul 26 05:03:49.938477 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 214/409] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:49 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:50.597915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:50.598943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:50.608642 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:50.609216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:50.610373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:50.610938 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:50.766432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:50.774522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-82c6d4bd-5a35-4e73-8501-4a261b50de75 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.183063 Jul 26 05:03:50.775101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 196/410] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:50 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:50.958793 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:50.959378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:50.966417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:50.966885 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:50.967700 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:50.968124 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:51.118974 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:51.126824 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dd00eb17-824b-48c1-8d0c-da8ce296c8ff tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1266 microversion: 2.1 time: 0.172254 Jul 26 05:03:51.127424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 215/411] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:50 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:51.796233 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:51.796772 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:51.804165 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:51.804638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:51.805382 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:51.805809 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:51.950499 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:51.958963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-43f5639b-85dc-45b8-9559-83dca2f97248 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.166766 Jul 26 05:03:51.959529 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 197/412] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:51 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:52.149027 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:52.149624 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:52.156562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.157003 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:52.157752 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.158176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:52.301559 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:52.312716 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7a8c6642-74da-4cde-9bf5-ab9277de2bee tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1453 microversion: 2.1 time: 0.167436 Jul 26 05:03:52.313521 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 216/413] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:52 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:52.338861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:52.338861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:52.343271 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.343729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:52.344485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.344913 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:52.489731 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:52.501714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ac766699-0a98-4d3d-9645-e51679c547fe tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1453 microversion: 2.1 time: 0.169978 Jul 26 05:03:52.502451 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 198/414] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:52 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:52.980573 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:52.981071 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:52.987662 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.988107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:52.989005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:52.989433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:53.124533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:53.128119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=100 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:53.133207 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-80193aaa-b904-4ac5-ac2e-56cbedb37594 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.156658 Jul 26 05:03:53.133750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 217/415] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:52 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:54.154808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:54.155419 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:54.163439 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:54.163921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:54.164718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:54.165152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:54.296355 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:54.304643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5e644273-9fd7-4093-96e9-8b55dbaa4f02 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.153664 Jul 26 05:03:54.312403 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 199/416] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:54 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:54.547599 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-6172107d-540f-49d4-8419-00bfdce06b3f req-088d1598-3a8a-4084-ba3e-9b778b74fc19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d72962b6-f3c4-41b4-96fd-5045b03faf2a", "tag": "6cf9eff0-8091-47a1-b175-0369e3eb4648"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:54.558099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-6172107d-540f-49d4-8419-00bfdce06b3f req-088d1598-3a8a-4084-ba3e-9b778b74fc19 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:54.558533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-6172107d-540f-49d4-8419-00bfdce06b3f req-088d1598-3a8a-4084-ba3e-9b778b74fc19 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:54.570534 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-6172107d-540f-49d4-8419-00bfdce06b3f req-088d1598-3a8a-4084-ba3e-9b778b74fc19 service nova] Creating event network-changed:6cf9eff0-8091-47a1-b175-0369e3eb4648 for instance d72962b6-f3c4-41b4-96fd-5045b03faf2a on hv-cinder-85057 Jul 26 05:03:54.575679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-6172107d-540f-49d4-8419-00bfdce06b3f req-088d1598-3a8a-4084-ba3e-9b778b74fc19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031830 Jul 26 05:03:54.576254 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 218/417] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:03:55.326656 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:55.327275 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:55.334457 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:55.334895 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:55.335771 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:55.336192 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:55.482602 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:55.490692 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5e4750e8-5e0b-4eee-ae25-47c62e070151 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.168005 Jul 26 05:03:55.491289 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 200/418] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:55 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:56.513711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:56.514418 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:56.521578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:56.522022 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:56.522780 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:56.523240 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:56.662458 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:56.670770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16c44338-4100-4457-be36-157eff7c8630 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.161987 Jul 26 05:03:56.671310 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 219/419] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:56 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:57.693687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:57.694273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:57.702068 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:57.702588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:57.703431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:57.703961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:57.844338 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:57.852051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-080219d2-9dfd-4c1d-9643-c538049d46d2 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1677 microversion: 2.1 time: 0.163352 Jul 26 05:03:57.852662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 201/420] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:57 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:58.874058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:58.874679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:58.881819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:58.882262 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:58.883026 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:58.883460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:59.028586 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:59.040935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e5837492-379b-40cb-af3d-c2f066de98a3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1654 microversion: 2.1 time: 0.170520 Jul 26 05:03:59.041654 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 220/421] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:58 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1654 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:03:59.065069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d740eea7-48aa-4cfd-a775-ca77e4f26e2e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:03:59.072011 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d740eea7-48aa-4cfd-a775-ca77e4f26e2e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:59.072434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d740eea7-48aa-4cfd-a775-ca77e4f26e2e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:59.094902 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d740eea7-48aa-4cfd-a775-ca77e4f26e2e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Going to try to start instance {{(pid=117993) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 05:03:59.140712 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d740eea7-48aa-4cfd-a775-ca77e4f26e2e tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action" status: 202 len: 0 microversion: 2.1 time: 0.079407 Jul 26 05:03:59.141508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 202/422] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:03:59 2022] POST /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:03:59.149656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:03:59.150264 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:03:59.156438 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:59.156907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:59.157650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:03:59.158069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:03:59.291143 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:03:59.298852 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8545279a-08ea-4a89-82b0-425cb27ab927 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1663 microversion: 2.1 time: 0.153067 Jul 26 05:03:59.300102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 221/423] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:03:59 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:00.322667 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:00.323266 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:00.330488 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:00.330939 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:00.331749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:00.332186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:00.471272 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:00.478960 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-37f4f89c-b83a-4499-a1f4-93972b11c184 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1663 microversion: 2.1 time: 0.161279 Jul 26 05:04:00.479528 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 203/424] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:00 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:01.500625 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:01.501341 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:01.508668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:01.509192 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:01.510054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:01.510561 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:01.724102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:01.731879 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c6d8d9f2-9df4-45b9-bbe5-0e2e1b6930f0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1667 microversion: 2.1 time: 0.235080 Jul 26 05:04:01.732453 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 222/425] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:01 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1667 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:12.733881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-96782fe9-0c8e-48c0-a780-cb0fb47ae554 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ec79260-e3a6-4daf-9f3e-db30a9053f7a"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:12.737500 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-96782fe9-0c8e-48c0-a780-cb0fb47ae554 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:12.741505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=27 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:12.742470 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:12.750514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-96782fe9-0c8e-48c0-a780-cb0fb47ae554 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:12.750952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-96782fe9-0c8e-48c0-a780-cb0fb47ae554 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:12.751739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-96782fe9-0c8e-48c0-a780-cb0fb47ae554 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:12.752166 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-96782fe9-0c8e-48c0-a780-cb0fb47ae554 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:13.046948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-96782fe9-0c8e-48c0-a780-cb0fb47ae554 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319278 Jul 26 05:04:13.047584 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 204/426] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:04:12 2022] POST /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:20.640068 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:20.642661 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:20.644857 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=21 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:20.645477 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=26 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:20.651642 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:20.652088 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:20.652873 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:20.653300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:20.676861 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lazy-loading 'flavor' on Instance uuid d8ea2890-2edd-445f-a103-85febb5cee98 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:04:20.811198 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fa363b0b-46e2-4d8b-873c-71e8b039f10a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/action" status: 200 len: 32 microversion: 2.1 time: 0.177884 Jul 26 05:04:20.811843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 223/427] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:04:20 2022] POST /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:04:20.823175 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:20.823885 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:20.830197 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:20.830637 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:20.831426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:20.831862 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:21.068526 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:21.076573 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e3e320e7-b93c-4d8a-9755-44fa9d425a37 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.258158 Jul 26 05:04:21.077155 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 205/428] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:20 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:22.103054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:22.103837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:22.112588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.113033 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.113813 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.114232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.166903 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aa27d1e6-1297-46e1-b6da-9e190fb04c4e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:22.167498 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aa27d1e6-1297-46e1-b6da-9e190fb04c4e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:22.174496 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa27d1e6-1297-46e1-b6da-9e190fb04c4e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.174999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa27d1e6-1297-46e1-b6da-9e190fb04c4e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.175904 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa27d1e6-1297-46e1-b6da-9e190fb04c4e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.176387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa27d1e6-1297-46e1-b6da-9e190fb04c4e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.206321 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aa27d1e6-1297-46e1-b6da-9e190fb04c4e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments/c440fd9f-b4af-4fc1-a2c9-eda1c70104f8" status: 200 len: 194 microversion: 2.20 time: 0.043478 Jul 26 05:04:22.207322 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 206/429] 10.222.0.17 () {60 vars in 1454 bytes} [Tue Jul 26 05:04:22 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments/c440fd9f-b4af-4fc1-a2c9-eda1c70104f8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:04:22.250890 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:22.259056 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d82f07cb-a1c0-4a55-96d8-2f036b16a6d6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.163194 Jul 26 05:04:22.259646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 224/430] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:22 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:22.276537 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:22.277022 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:22.283455 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.283930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.284673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.285095 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.372458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lazy-loading 'services' on Instance uuid 02b3bcc1-fe56-4edd-b25a-a2c338610939 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:04:22.450116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-65bbb348-f8bd-4181-ab2e-692ba91f90a9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments/c440fd9f-b4af-4fc1-a2c9-eda1c70104f8" status: 202 len: 0 microversion: 2.20 time: 0.177630 Jul 26 05:04:22.450752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 207/431] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Jul 26 05:04:22 2022] DELETE /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments/c440fd9f-b4af-4fc1-a2c9-eda1c70104f8 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:04:22.460485 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-52ed1142-a58c-467e-adc1-9c2471df5863 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:22.462756 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-52ed1142-a58c-467e-adc1-9c2471df5863 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:22.469531 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52ed1142-a58c-467e-adc1-9c2471df5863 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.470060 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52ed1142-a58c-467e-adc1-9c2471df5863 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.470948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52ed1142-a58c-467e-adc1-9c2471df5863 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:22.471454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52ed1142-a58c-467e-adc1-9c2471df5863 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:22.504917 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-52ed1142-a58c-467e-adc1-9c2471df5863 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049375 Jul 26 05:04:22.505479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 225/432] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Jul 26 05:04:22 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 05:04:23.281233 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:23.281951 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:23.288751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.289192 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.289947 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.290384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.437456 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:23.447292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-da89d450-e4b2-46e1-a80f-02b1e2ad2d35 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.171031 Jul 26 05:04:23.447942 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 208/433] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:23 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:23.520034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2218eda1-0fd6-4842-8ba7-f1b1a529c960 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:23.522189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2218eda1-0fd6-4842-8ba7-f1b1a529c960 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:23.529168 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2218eda1-0fd6-4842-8ba7-f1b1a529c960 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.529609 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2218eda1-0fd6-4842-8ba7-f1b1a529c960 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.530399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2218eda1-0fd6-4842-8ba7-f1b1a529c960 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.530829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2218eda1-0fd6-4842-8ba7-f1b1a529c960 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.561464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2218eda1-0fd6-4842-8ba7-f1b1a529c960 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045466 Jul 26 05:04:23.562070 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 226/434] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Jul 26 05:04:23 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:23.626349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:23.626842 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:23.633349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.633808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.634571 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.634998 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.660379 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:04:23.765715 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c8d6d9c8-2393-4570-afbf-443a00556040 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 204 len: 0 microversion: 2.20 time: 0.142857 Jul 26 05:04:23.766372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 209/435] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Jul 26 05:04:23 2022] DELETE /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 05:04:23.777344 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:23.778214 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:23.787129 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.787576 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.788577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:23.789146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:23.931656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:23.940542 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:23.942069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:23.943639 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6eb35746-aefa-493c-89fe-c02f98196463 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.172318 Jul 26 05:04:23.944208 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 227/436] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:23 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:04:24.472859 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:24.473825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:24.483388 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:24.484065 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:24.485101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:24.485745 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:24.619104 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:24.627871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-39bf4716-1be6-47f6-a29d-15dff8aeb4a1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.161147 Jul 26 05:04:24.628448 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 210/437] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:24 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:24.969802 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:24.970500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:24.980342 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:24.980972 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:24.982053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:24.982607 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:25.140931 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:25.150712 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:25.152233 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:25.153418 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a9b22ff9-ce69-436d-8b36-6acf15b8bdba tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.189682 Jul 26 05:04:25.153981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 228/438] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:24 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:25.653805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:25.654633 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:25.664937 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:25.665713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:25.666989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:25.667798 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:25.912046 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:25.920543 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-af1ee510-1485-40e5-afce-4023f49d8e10 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.273165 Jul 26 05:04:25.921159 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 211/439] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:25 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:26.184289 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:26.184865 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:26.192837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:26.193296 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:26.194046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:26.194477 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:26.467477 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:26.476392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:26.477885 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:26.479048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-117a3d0b-09b2-4d0f-b151-b78150acfffd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1722 microversion: 2.20 time: 0.298946 Jul 26 05:04:26.479644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 229/440] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:26 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:26.943807 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:26.945046 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:26.951720 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:26.952501 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:26.953547 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:26.954041 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:27.078904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-8bd6b209-6945-47a2-a580-f2d07a47dbae req-2d3cbdfb-ded8-488b-bac2-23ea45afc4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b3bcc1-fe56-4edd-b25a-a2c338610939", "name": "network-vif-deleted", "tag": "a540d166-7fe8-4084-911e-a2037b5f9fd5"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:27.100711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8bd6b209-6945-47a2-a580-f2d07a47dbae req-2d3cbdfb-ded8-488b-bac2-23ea45afc4e4 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:27.104175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8bd6b209-6945-47a2-a580-f2d07a47dbae req-2d3cbdfb-ded8-488b-bac2-23ea45afc4e4 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:27.119397 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-8bd6b209-6945-47a2-a580-f2d07a47dbae req-2d3cbdfb-ded8-488b-bac2-23ea45afc4e4 service nova] Creating event network-vif-deleted:a540d166-7fe8-4084-911e-a2037b5f9fd5 for instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 on hv-cinder-85057 Jul 26 05:04:27.128601 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-8bd6b209-6945-47a2-a580-f2d07a47dbae req-2d3cbdfb-ded8-488b-bac2-23ea45afc4e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053188 Jul 26 05:04:27.129559 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 230/441] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:27.150867 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:27.161510 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ddbab762-f08c-495d-a9ec-42f32efd2f2e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.222855 Jul 26 05:04:27.176876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 212/442] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:26 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:27.504043 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:27.504770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:27.511832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:27.512276 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:27.513018 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:27.513454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:27.547043 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:27.547439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:27.547954 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lazy-loading 'fault' on Instance uuid 02b3bcc1-fe56-4edd-b25a-a2c338610939 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:04:27.598038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:27.610193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:27.613112 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:27.614880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a0461ad5-0b99-4579-85f9-d4ee7c3584fa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 200 len: 1371 microversion: 2.20 time: 0.115978 Jul 26 05:04:27.616045 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 231/443] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:27 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:28.183232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:28.183954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:28.191862 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:28.192848 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:28.193900 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:28.194394 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:28.340418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:28.350761 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-32cc1ca6-b742-4f2f-851a-55073c88cc96 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.171884 Jul 26 05:04:28.351378 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 213/444] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:28 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:28.639360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:28.640005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:28.647109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:28.647585 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:28.648374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:28.648804 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:28.662858 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] HTTP exception thrown: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Request method failure captured: Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 HTTP/1.1 Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TWCkfaLpFwVzykqsIb80MiKZSyY8clU4-oJS0KfmarGK3oknqlYpX7-dlpgb5LFGptotOesQoWNLqdLWWuGB8SDZ3Awl6eKeyoZFiYwRG8iBOp5rauNIvDexju_4iMjWOLIaNmHmVLei-NQ9HrSIQiK3h2RiYxNjyuxbTMHZQIKVw Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:04:28.664562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27187d178a5f47b49035991ab566c2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}] Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: f996bed3f6064c6dbf04d26c7c04df7c Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:04:28.666279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '02b3bcc1-fe56-4edd-b25a-a2c338610939'} Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:04:28.667122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:04:28.668441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:04:28.669750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Returning 404 to user: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:04:28.669750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e87f3ca4-f5e2-41be-9d8f-6a79ca57e15a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 404 len: 111 microversion: 2.20 time: 0.031054 Jul 26 05:04:28.669750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 232/445] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:28 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:04:28.675390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3834eb6e-1f83-4b26-b37d-c1e463bd5985 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '.version_select at 0x7f0e952adee0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:28.699367 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3834eb6e-1f83-4b26-b37d-c1e463bd5985 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159963161" status: 204 len: 0 microversion: 2.20 time: 0.027861 Jul 26 05:04:28.700019 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 214/446] 10.222.0.17 () {60 vars in 1262 bytes} [Tue Jul 26 05:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159963161 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 05:04:29.372103 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:29.372708 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:29.373857 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-81f28da0-2f89-4cbd-b8b2-889b728f5a1c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'create', calling method: .version_select at 0x7f0e951b6dc0>, body: {"keypair": {"name": "tempest-keypair-1105748622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6GNmq6hHSggdZkVJfOX1dq7VpH83hiXjz4oJcDRleoA5G1yQt8eUfqjEseBpVLCol8co8rzhh3+U/TZ4QwYZzPKN5pWUjGp7+I4DmVxdPxKmeWm68UV3m0uI2s4LSPkA=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:29.379110 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:29.379595 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:29.380389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:29.380798 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:29.391426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-81f28da0-2f89-4cbd-b8b2-889b728f5a1c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for project 27187d178a5f47b49035991ab566c2d9. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:29.395596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-81f28da0-2f89-4cbd-b8b2-889b728f5a1c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for user f996bed3f6064c6dbf04d26c7c04df7c and project 27187d178a5f47b49035991ab566c2d9. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:29.423145 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-81f28da0-2f89-4cbd-b8b2-889b728f5a1c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052856 Jul 26 05:04:29.423766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 215/447] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Jul 26 05:04:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 26 05:04:29.541559 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:29.550184 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-85924f60-01ba-46c2-ac44-52fc7895d555 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.182098 Jul 26 05:04:29.550719 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 233/448] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:29 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:30.572886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:30.573443 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:30.580419 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:30.580792 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:30.581568 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:30.582638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:30.779542 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:30.788015 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6cc01f42-0922-4df5-ba56-ecfbc9e06bc6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.219404 Jul 26 05:04:30.788629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 216/449] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:30 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:30.859188 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1835441199", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b59dfcee-9319-4218-b70b-67be8305e37d"}], "security_groups": [{"name": "tempest-securitygroup--1559546221"}], "key_name": "tempest-keypair-1105748622", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:30.979577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] validate_networks() for [('b59dfcee-9319-4218-b70b-67be8305e37d', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:04:31.374130 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:04:31.374545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:04:31.375006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:04:31.375407 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:04:31.375831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:04:31.385878 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:31.386318 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:31.387098 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:31.387500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:31.405021 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for project 27187d178a5f47b49035991ab566c2d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:31.409392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Getting quotas for user f996bed3f6064c6dbf04d26c7c04df7c and project 27187d178a5f47b49035991ab566c2d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:31.421551 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:04:31.423866 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:04:31.472474 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1f428e6f-7f9d-409b-8764-7f60a0b7a4a0 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.617723 Jul 26 05:04:31.473171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 234/450] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Jul 26 05:04:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 05:04:31.485017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-edb59856-35f5-4e1d-b372-662538cf3de9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:31.485837 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-edb59856-35f5-4e1d-b372-662538cf3de9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:31.546400 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-edb59856-35f5-4e1d-b372-662538cf3de9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:31.554387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-edb59856-35f5-4e1d-b372-662538cf3de9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:31.556760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-edb59856-35f5-4e1d-b372-662538cf3de9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:31.557864 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-edb59856-35f5-4e1d-b372-662538cf3de9 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1282 microversion: 2.20 time: 0.077618 Jul 26 05:04:31.558422 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 217/451] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:31 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:04:31.810308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:31.811043 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:31.818754 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:31.819245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:31.820125 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:31.820620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:31.961259 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:31.970098 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6accd349-25cb-4a6f-b094-26056acc60fb tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.164099 Jul 26 05:04:31.970799 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 235/452] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:31 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:32.581384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:32.581962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:32.588907 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:32.589366 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:32.590116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:32.591143 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:32.656431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:32.664523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:32.666013 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:32.667115 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9c519715-e11a-4d23-9443-8f02ee208bfd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1278 microversion: 2.20 time: 0.089821 Jul 26 05:04:32.667741 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 218/453] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:32 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:32.992690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:32.993396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:33.000308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.001060 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.007707 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.008217 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.172444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:33.181009 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-24b4227e-1ddb-4051-ada5-1d3516f29087 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.192368 Jul 26 05:04:33.181586 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 236/454] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:32 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:33.693780 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:33.694367 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:33.701671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.702109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.702905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:33.703329 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:33.809851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:33.813583 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:33.820199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:33.821676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:33.823007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-24769a88-6325-4479-b618-6f11ef38fc3f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1342 microversion: 2.20 time: 0.135424 Jul 26 05:04:33.823585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 219/455] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:33 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:34.202703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:34.203502 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:34.210492 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:34.210969 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:34.211745 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:34.212172 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:34.389983 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:34.403488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-331eb897-3c71-4d43-bb79-631ad4cef673 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1736 microversion: 2.1 time: 0.204690 Jul 26 05:04:34.404226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 237/456] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:34 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:34.846351 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:34.846963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:34.856659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:34.857095 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:34.857862 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:34.858313 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:34.991950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:35.000481 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:35.001993 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:35.003097 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-55f2385a-342b-4d5f-a3f7-92d3665fbd64 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1408 microversion: 2.20 time: 0.161165 Jul 26 05:04:35.003900 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 220/457] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:34 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:35.428033 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:35.428759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:35.436200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:35.436690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:35.437469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:35.437892 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:35.756114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:35.764766 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a9307a98-e481-4910-bffe-4020e21960f7 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1716 microversion: 2.1 time: 0.340579 Jul 26 05:04:35.765192 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 238/458] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:35 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1716 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:35.896617 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:35.897226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:35.904070 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:35.904514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:35.905575 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:35.905946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:35.995308 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] HTTP exception thrown: Cannot 'detach_volume' instance d8ea2890-2edd-445f-a103-85febb5cee98 while it is in vm_state rescued Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Request method failure captured: Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments/9ec79260-e3a6-4daf-9f3e-db30a9053f7a HTTP/1.1 Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TppTZEIzE22-l0k1qVXQWFi1a4JpacOX6I-ukPvNKWTV4LGXoFjlyR-pLI_c381psvsgMHG-u3LvGb0svyIeLIyuUv9BMz_8zzxmMG2arWGttFKsDh22CIjO14XDEMubNks0nJxAMMTXQ83lZ7CLF6KWj8TGQFie_JksEnHe0O0bM Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:04:35.997144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}] Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f0cc1af7d7d642889a1a11103f087e79 Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:04:35.998669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Cannot 'detach_volume' instance d8ea2890-2edd-445f-a103-85febb5cee98 while it is in vm_state rescued Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'server_id': 'd8ea2890-2edd-445f-a103-85febb5cee98', 'id': '9ec79260-e3a6-4daf-9f3e-db30a9053f7a'} Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8ea2890-2edd-445f-a103-85febb5cee98 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:04:35.999463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d8ea2890-2edd-445f-a103-85febb5cee98 while it is in vm_state rescued Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d8ea2890-2edd-445f-a103-85febb5cee98 while it is in vm_state rescued Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:36.001052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Returning 409 to user: Cannot 'detach_volume' instance d8ea2890-2edd-445f-a103-85febb5cee98 while it is in vm_state rescued {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:04:36.002336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-300372ee-6e11-41d5-82d6-7e37223bd127 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments/9ec79260-e3a6-4daf-9f3e-db30a9053f7a" status: 409 len: 152 microversion: 2.1 time: 0.107809 Jul 26 05:04:36.003915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 221/459] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:04:35 2022] DELETE /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments/9ec79260-e3a6-4daf-9f3e-db30a9053f7a => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 05:04:36.010542 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-558297f4-0472-4db4-a742-34814c6c685d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:36.011075 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-558297f4-0472-4db4-a742-34814c6c685d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:36.017207 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-558297f4-0472-4db4-a742-34814c6c685d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.017897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-558297f4-0472-4db4-a742-34814c6c685d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.018851 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-558297f4-0472-4db4-a742-34814c6c685d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.019438 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-558297f4-0472-4db4-a742-34814c6c685d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.024073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:36.027851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:36.028518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:36.035048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.035514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.036309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.036912 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.102445 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-558297f4-0472-4db4-a742-34814c6c685d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "POST /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/action" status: 202 len: 0 microversion: 2.1 time: 0.095372 Jul 26 05:04:36.107081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 239/460] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:04:36 2022] POST /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:04:36.112955 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:36.113889 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:36.121782 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.122455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.123522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.124217 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.397735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:36.408196 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:36.410112 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:36.412549 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f53b0b03-a9ab-4449-ab5d-4063b749f68c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1408 microversion: 2.20 time: 0.389897 Jul 26 05:04:36.413335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 222/461] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:36 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:36.417433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:36.418525 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-a7e3ebfd-86dd-4feb-a2a8-4e9732e5dfaf req-3dc574b9-7c76-4239-8337-fb63feda52ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e577df-08fa-4428-a9a2-44458ca27e2a", "tag": "19c54117-94e3-4ff4-a8ce-06b6514cd2e6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:36.426261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-46fd9059-a79d-4540-b315-3b4eded377ae tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1724 microversion: 2.1 time: 0.317620 Jul 26 05:04:36.426835 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 240/462] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:36 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:36.445712 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a7e3ebfd-86dd-4feb-a2a8-4e9732e5dfaf req-3dc574b9-7c76-4239-8337-fb63feda52ec service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:36.446391 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a7e3ebfd-86dd-4feb-a2a8-4e9732e5dfaf req-3dc574b9-7c76-4239-8337-fb63feda52ec service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:36.458820 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-a7e3ebfd-86dd-4feb-a2a8-4e9732e5dfaf req-3dc574b9-7c76-4239-8337-fb63feda52ec service nova] Creating event network-changed:19c54117-94e3-4ff4-a8ce-06b6514cd2e6 for instance e2e577df-08fa-4428-a9a2-44458ca27e2a on hv-cinder-85057 Jul 26 05:04:36.464593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-a7e3ebfd-86dd-4feb-a2a8-4e9732e5dfaf req-3dc574b9-7c76-4239-8337-fb63feda52ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049920 Jul 26 05:04:36.465579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 223/463] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:37.439432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:37.440333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:37.448138 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:37.448578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:37.449347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:37.449486 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:37.449901 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:37.450185 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:37.457349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:37.457793 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:37.458564 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:37.458996 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:37.706242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:37.716042 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:37.718251 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:37.719723 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-edaaa480-d216-4639-b184-eaa651b7191b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1408 microversion: 2.20 time: 0.286524 Jul 26 05:04:37.721208 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 241/464] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:37 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:37.731953 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:37.742328 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-233ebccd-1e9d-412f-a71b-a4f300bf3cfa tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1724 microversion: 2.1 time: 0.297763 Jul 26 05:04:37.748747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 224/465] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:37 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:04:38.745943 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:38.746520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:38.756482 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:38.757083 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:38.758005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:38.758451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:38.765165 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:38.765881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:38.773125 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:38.773567 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:38.774323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:38.774744 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:38.955479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:38.962780 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:38.964187 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:38.965706 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:38.966983 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-68d9eb99-8c95-40ad-a246-36a73d195e7a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1408 microversion: 2.20 time: 0.227126 Jul 26 05:04:38.967590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 242/466] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:38 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:38.971232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ea8c4f3c-c7fc-4879-8162-d1ed53efaa77 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1724 microversion: 2.1 time: 0.209892 Jul 26 05:04:38.971843 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 225/467] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:38 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:39.843522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-2c8f3bd4-c6a7-4bcc-a902-4e4087248c4e req-3c8c21e8-ba11-444f-80db-089ab17bc9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e577df-08fa-4428-a9a2-44458ca27e2a", "name": "network-vif-plugged", "status": "completed", "tag": "19c54117-94e3-4ff4-a8ce-06b6514cd2e6"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:39.854201 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2c8f3bd4-c6a7-4bcc-a902-4e4087248c4e req-3c8c21e8-ba11-444f-80db-089ab17bc9a3 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:39.854691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2c8f3bd4-c6a7-4bcc-a902-4e4087248c4e req-3c8c21e8-ba11-444f-80db-089ab17bc9a3 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:39.865881 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-2c8f3bd4-c6a7-4bcc-a902-4e4087248c4e req-3c8c21e8-ba11-444f-80db-089ab17bc9a3 service nova] Creating event network-vif-plugged:19c54117-94e3-4ff4-a8ce-06b6514cd2e6 for instance e2e577df-08fa-4428-a9a2-44458ca27e2a on hv-cinder-85057 Jul 26 05:04:39.870993 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-2c8f3bd4-c6a7-4bcc-a902-4e4087248c4e req-3c8c21e8-ba11-444f-80db-089ab17bc9a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031264 Jul 26 05:04:39.871788 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 243/468] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:39.990727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:39.991365 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:39.994884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:39.995604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:39.998658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:39.999128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:39.999956 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.000432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.002059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.002497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.003278 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.003739 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.224053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:40.224172 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:40.229839 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:40.231341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:40.232478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5401d8aa-5ab3-4d4d-a5a3-48d4e49da50e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1408 microversion: 2.20 time: 0.245944 Jul 26 05:04:40.232596 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2d927f8f-414a-43fd-8fa5-b0f1cea4e33c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1724 microversion: 2.1 time: 0.242809 Jul 26 05:04:40.233034 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 226/469] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:39 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:40.233164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 244/470] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:39 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:04:40.560809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b38f69fe-4562-45cb-8eec-f1d23ac007e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:40.562971 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b38f69fe-4562-45cb-8eec-f1d23ac007e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:40.569750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38f69fe-4562-45cb-8eec-f1d23ac007e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.570198 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38f69fe-4562-45cb-8eec-f1d23ac007e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.570967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38f69fe-4562-45cb-8eec-f1d23ac007e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.571397 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38f69fe-4562-45cb-8eec-f1d23ac007e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.601473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b38f69fe-4562-45cb-8eec-f1d23ac007e6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044791 Jul 26 05:04:40.602047 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 245/471] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:04:40 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:04:40.675515 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:40.676017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:40.683949 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.684395 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.685156 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.685593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.710533 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:04:40.795318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-115aeaa9-5659-4f25-940a-9664639ed2dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 204 len: 0 microversion: 2.1 time: 0.125590 Jul 26 05:04:40.796111 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 227/472] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:04:40 2022] DELETE /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:04:40.804523 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:40.805137 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:40.811452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.811865 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.812637 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:40.813074 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:40.946467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:40.954799 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-96a0586b-399c-4255-8793-df58a76e103c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1673 microversion: 2.1 time: 0.154197 Jul 26 05:04:40.955369 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 246/473] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:40 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:41.254709 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:41.254970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:41.255475 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:41.255601 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:41.262150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.262387 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.262580 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.262714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.263329 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.263468 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.263790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.263953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.394424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:41.417063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:41.459967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:41.463878 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:41.469242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:41.470996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:41.472177 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b405ccf0-d621-41e2-9b61-ffba5d8a949f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1408 microversion: 2.20 time: 0.221449 Jul 26 05:04:41.472381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a437f9b0-4b17-4aa5-a356-a8c577a7fab1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1730 microversion: 2.1 time: 0.221665 Jul 26 05:04:41.472720 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 247/474] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:41 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:41.472986 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 228/475] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:41 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:41.492862 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b8479ff6-f5bc-4c6b-9abd-d22000d024db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:41.493350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b8479ff6-f5bc-4c6b-9abd-d22000d024db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:41.500002 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8479ff6-f5bc-4c6b-9abd-d22000d024db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.500444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8479ff6-f5bc-4c6b-9abd-d22000d024db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.501198 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8479ff6-f5bc-4c6b-9abd-d22000d024db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.501622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8479ff6-f5bc-4c6b-9abd-d22000d024db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.582409 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b8479ff6-f5bc-4c6b-9abd-d22000d024db tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092926 Jul 26 05:04:41.583337 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 248/476] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:04:41 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:41.976342 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:41.976881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:41.979072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:41.984761 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.985205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:41.985974 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:41.986390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:42.193726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:42.201796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fe9f84e5-e9dd-4e65-b51b-ab874ca265c0 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1673 microversion: 2.1 time: 0.229398 Jul 26 05:04:42.202367 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 229/477] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:41 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:42.496329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:42.496942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:42.504012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:42.504465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:42.505257 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:42.506034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:42.607213 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-d6271c3e-425b-490f-b99b-46adff62b8ce req-c4e4d50f-e9e4-4260-a4de-094eaaa4cda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ea2890-2edd-445f-a103-85febb5cee98", "tag": "d1799624-13c2-451d-96a9-a79751ea030c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:42.617596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-d6271c3e-425b-490f-b99b-46adff62b8ce req-c4e4d50f-e9e4-4260-a4de-094eaaa4cda7 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:42.618485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-d6271c3e-425b-490f-b99b-46adff62b8ce req-c4e4d50f-e9e4-4260-a4de-094eaaa4cda7 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:42.631836 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-d6271c3e-425b-490f-b99b-46adff62b8ce req-c4e4d50f-e9e4-4260-a4de-094eaaa4cda7 service nova] Creating event network-changed:d1799624-13c2-451d-96a9-a79751ea030c for instance d8ea2890-2edd-445f-a103-85febb5cee98 on hv-cinder-85057 Jul 26 05:04:42.637196 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-d6271c3e-425b-490f-b99b-46adff62b8ce req-c4e4d50f-e9e4-4260-a4de-094eaaa4cda7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033552 Jul 26 05:04:42.637774 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 230/478] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:04:42.685896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:42.694361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:42.695898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:42.697116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a3d0bd90-1975-4d42-a644-4eda5cd2af1a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1408 microversion: 2.20 time: 0.205685 Jul 26 05:04:42.697684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 249/479] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:42 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:43.225325 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:43.226149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:43.228463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:43.234675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.235290 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:43.236101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.236622 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:43.377479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:43.385706 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ce41bca7-dbc3-4a21-9f50-9208aa9250de tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1673 microversion: 2.1 time: 0.166706 Jul 26 05:04:43.386493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 231/480] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:43 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:43.722500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:43.723075 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:43.732843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.733291 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:43.734396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.734982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:43.882662 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:43.891444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:43.893055 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:43.894240 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ead15fb6-df56-42f9-b201-1beed09d6fa8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1599 microversion: 2.20 time: 0.177901 Jul 26 05:04:43.895157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 250/481] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:04:43 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:04:43.917628 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-32dac405-1186-4731-8df6-9b90bc164e35 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:43.918128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-32dac405-1186-4731-8df6-9b90bc164e35 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:43.924926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32dac405-1186-4731-8df6-9b90bc164e35 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.925368 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32dac405-1186-4731-8df6-9b90bc164e35 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:43.926407 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32dac405-1186-4731-8df6-9b90bc164e35 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:43.926840 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32dac405-1186-4731-8df6-9b90bc164e35 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:44.037538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-32dac405-1186-4731-8df6-9b90bc164e35 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.124601 Jul 26 05:04:44.039039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 232/482] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Jul 26 05:04:43 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:04:44.406444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:44.407040 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:44.414156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:44.414603 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:44.415412 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:44.415879 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:44.657483 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-5f67009c-be10-41f3-ba1a-94a25a012a97 req-8df39acf-30c3-4166-b15e-df8c2cf961e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ea2890-2edd-445f-a103-85febb5cee98", "tag": "d1799624-13c2-451d-96a9-a79751ea030c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:44.663997 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:44.668879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5f67009c-be10-41f3-ba1a-94a25a012a97 req-8df39acf-30c3-4166-b15e-df8c2cf961e6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:44.670029 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5f67009c-be10-41f3-ba1a-94a25a012a97 req-8df39acf-30c3-4166-b15e-df8c2cf961e6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:44.674715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2ac3dc92-4ade-4d8b-b12b-e663d5d026dd tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1673 microversion: 2.1 time: 0.272083 Jul 26 05:04:44.675816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 251/483] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:44 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1673 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:44.685222 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-5f67009c-be10-41f3-ba1a-94a25a012a97 req-8df39acf-30c3-4166-b15e-df8c2cf961e6 service nova] Creating event network-changed:d1799624-13c2-451d-96a9-a79751ea030c for instance d8ea2890-2edd-445f-a103-85febb5cee98 on hv-cinder-85057 Jul 26 05:04:44.690414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-5f67009c-be10-41f3-ba1a-94a25a012a97 req-8df39acf-30c3-4166-b15e-df8c2cf961e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037391 Jul 26 05:04:44.691078 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 233/484] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:45.673351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-5b3b31ac-6433-47f3-96ce-86688a48c346 req-5dba80a0-0227-410a-a935-25678aec5420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e577df-08fa-4428-a9a2-44458ca27e2a", "tag": "19c54117-94e3-4ff4-a8ce-06b6514cd2e6"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:45.698754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:45.699456 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:45.703784 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-5b3b31ac-6433-47f3-96ce-86688a48c346 req-5dba80a0-0227-410a-a935-25678aec5420 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:45.710980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:45.711429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:45.712336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:45.712776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:45.715462 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-5b3b31ac-6433-47f3-96ce-86688a48c346 req-5dba80a0-0227-410a-a935-25678aec5420 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:45.731469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-5b3b31ac-6433-47f3-96ce-86688a48c346 req-5dba80a0-0227-410a-a935-25678aec5420 service nova] Creating event network-changed:19c54117-94e3-4ff4-a8ce-06b6514cd2e6 for instance e2e577df-08fa-4428-a9a2-44458ca27e2a on hv-cinder-85057 Jul 26 05:04:45.748414 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-5b3b31ac-6433-47f3-96ce-86688a48c346 req-5dba80a0-0227-410a-a935-25678aec5420 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078449 Jul 26 05:04:45.749495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 252/485] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:45.777420 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:45.779714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:45.784186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lazy-loading 'fault' on Instance uuid 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:04:45.902698 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:45.910689 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-949b848b-8212-4585-a61d-caf8d3e7fcbe tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 200 len: 1326 microversion: 2.1 time: 0.216337 Jul 26 05:04:45.911518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 234/486] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:45 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 1326 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:46.732894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-a4db05a0-96a4-419a-81e6-6890a5ca9b53 req-c3998263-3bba-48b5-92e5-3984ebaa6b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3", "name": "network-vif-deleted", "tag": "358a3c7b-6b7d-446a-adf5-98c0f873899c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:46.743396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a4db05a0-96a4-419a-81e6-6890a5ca9b53 req-c3998263-3bba-48b5-92e5-3984ebaa6b46 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:46.743867 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a4db05a0-96a4-419a-81e6-6890a5ca9b53 req-c3998263-3bba-48b5-92e5-3984ebaa6b46 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:46.754853 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-a4db05a0-96a4-419a-81e6-6890a5ca9b53 req-c3998263-3bba-48b5-92e5-3984ebaa6b46 service nova] Creating event network-vif-deleted:358a3c7b-6b7d-446a-adf5-98c0f873899c for instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 on hv-cinder-85057 Jul 26 05:04:46.759924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-a4db05a0-96a4-419a-81e6-6890a5ca9b53 req-c3998263-3bba-48b5-92e5-3984ebaa6b46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031594 Jul 26 05:04:46.760574 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 253/487] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:46.933714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:46.934248 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:46.940783 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:46.941612 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:46.942391 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:46.942875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:46.958198 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] HTTP exception thrown: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Request method failure captured: Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 HTTP/1.1 Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33Tcj8aEgFWVoSxDwDNp8IVfCM4YUynvgpRtmxzPdQr8X-kb5Gem6m8Mzf7p74qM-XTeu40RHRW7y5RnFmhsqWuIYfyz4rtAInBN0Pkuhbj4vMdcHAVwChZMwNYNJl5ZsBFmJfIbS37QGwLQPE4QMIrCZ8BnsMOR2aRjyN5PkzBeJRo Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:04:46.959918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}] Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 39de5897bd2d4e2b91c05d8dda5827be Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:04:46.961239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3'} Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:04:46.961995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:04:46.963276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:04:46.964497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Returning 404 to user: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:04:46.964497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-91638f33-71ba-45e6-8537-cf1037ad2bd4 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 404 len: 111 microversion: 2.1 time: 0.031776 Jul 26 05:04:46.964497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 235/488] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:46 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:04:46.971324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f0ed1bf3-d638-49d5-851d-b0ead4c0e740 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '.version_select at 0x7f0e959e7e50>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:47.006273 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f0ed1bf3-d638-49d5-851d-b0ead4c0e740 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-912349614" status: 202 len: 0 microversion: 2.1 time: 0.039261 Jul 26 05:04:47.006819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 254/489] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Jul 26 05:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-912349614 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:04:47.680954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c3416d11-2dad-4ac8-84d7-8a260f2ebf03 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'create', calling method: .version_select at 0x7f0e9560cee0>, body: {"keypair": {"name": "tempest-keypair-529453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1TVXwHQZx7mITB8TqE1O4zX8nyGe6+6DBKT+3EAyS8i/Hmk6r1jlbybv6j2pjus3W520mz/x4FyIRg6NTzCzEN7UJ3eva+4r+wZSVKXSi92BRK0G75YkMjbkjF7mVVlA=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:47.697078 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-c3416d11-2dad-4ac8-84d7-8a260f2ebf03 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for project 9747c4b81e8844e989d70b8001a196b0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:47.701482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-c3416d11-2dad-4ac8-84d7-8a260f2ebf03 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for user 39de5897bd2d4e2b91c05d8dda5827be and project 9747c4b81e8844e989d70b8001a196b0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:47.723751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c3416d11-2dad-4ac8-84d7-8a260f2ebf03 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.046672 Jul 26 05:04:47.724370 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 236/490] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:04:47 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:04:49.074589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1467690906", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41d26926-2f73-4071-bfbf-1d55e6f46e9c"}], "security_groups": [{"name": "tempest-securitygroup--1736685643"}], "key_name": "tempest-keypair-529453", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:49.184849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] validate_networks() for [('41d26926-2f73-4071-bfbf-1d55e6f46e9c', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:04:49.608365 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:04:49.608789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:04:49.609265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:04:49.610309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:04:49.610309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:04:49.619712 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:49.620158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:49.620962 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:49.621397 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:49.638043 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for project 9747c4b81e8844e989d70b8001a196b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:04:49.642177 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Getting quotas for user 39de5897bd2d4e2b91c05d8dda5827be and project 9747c4b81e8844e989d70b8001a196b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:04:49.653409 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:04:49.655880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:04:49.667679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:49.711839 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6ea9b39f-7990-4f88-87c4-6e43d4b42ddb tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.642184 Jul 26 05:04:49.712705 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 255/491] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:04:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:04:49.724276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5ddd287d-482e-4a73-ac7c-fdf8ddc3abc6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:49.724916 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5ddd287d-482e-4a73-ac7c-fdf8ddc3abc6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:49.780104 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5ddd287d-482e-4a73-ac7c-fdf8ddc3abc6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:49.787460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5ddd287d-482e-4a73-ac7c-fdf8ddc3abc6 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1234 microversion: 2.1 time: 0.067674 Jul 26 05:04:49.788071 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 237/492] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:49 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1234 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:50.809688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:50.810460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:50.819253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:50.819710 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:50.820519 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:50.820925 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:50.902789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:50.911045 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-70a3f457-05db-43bd-a576-39a9f59a5a9f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1294 microversion: 2.1 time: 0.105904 Jul 26 05:04:50.911657 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 256/493] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:50 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:51.933627 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:51.934236 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:51.941497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:51.941937 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:51.942710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:51.943135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:52.124861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:52.132790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-50f27de0-9930-445b-9328-0c3ef5178f08 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1360 microversion: 2.1 time: 0.204053 Jul 26 05:04:52.133374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 238/494] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:51 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1360 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:52.469186 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-803a582a-b8fa-4d72-81fd-f1b8eaef6ede req-4c8f55ea-24ad-4551-8574-d1bf7b911014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfddd200-54c7-46ee-9bda-5868344fcb10", "tag": "714b804c-f359-4995-a514-95d668e03a97"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:52.480658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-803a582a-b8fa-4d72-81fd-f1b8eaef6ede req-4c8f55ea-24ad-4551-8574-d1bf7b911014 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:52.481097 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-803a582a-b8fa-4d72-81fd-f1b8eaef6ede req-4c8f55ea-24ad-4551-8574-d1bf7b911014 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:52.497751 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-803a582a-b8fa-4d72-81fd-f1b8eaef6ede req-4c8f55ea-24ad-4551-8574-d1bf7b911014 service nova] Creating event network-changed:714b804c-f359-4995-a514-95d668e03a97 for instance cfddd200-54c7-46ee-9bda-5868344fcb10 on hv-cinder-85057 Jul 26 05:04:52.502823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-803a582a-b8fa-4d72-81fd-f1b8eaef6ede req-4c8f55ea-24ad-4551-8574-d1bf7b911014 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037928 Jul 26 05:04:52.503432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 257/495] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:53.154222 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:53.154863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:53.161651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:53.162133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:53.162892 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:53.163323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:53.181972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:53.307702 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:53.315224 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bc4a44df-2be3-47a9-9cee-0d8f69986e8d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1360 microversion: 2.1 time: 0.164923 Jul 26 05:04:53.316185 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 239/496] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:53 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:54.338038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:54.339956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:54.346929 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:54.347545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:54.348683 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:54.349180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:54.822514 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:54.830363 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ef478383-b663-4bab-8158-1a417a6f87f9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1360 microversion: 2.1 time: 0.497433 Jul 26 05:04:54.830934 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 258/497] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:54 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1360 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:55.852197 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:55.852814 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:55.859765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:55.860216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:55.860990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:55.861426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:56.047318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:56.054783 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f7ec1f65-af28-4820-9012-da1c02112e87 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1360 microversion: 2.1 time: 0.206788 Jul 26 05:04:56.055349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 240/498] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:55 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:57.075234 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:57.075854 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:57.082994 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:57.083435 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:57.084236 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:57.084658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:57.103898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:04:57.230554 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:57.238785 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-adf7b091-3da3-42b8-80d8-781cb0843d92 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1360 microversion: 2.1 time: 0.167471 Jul 26 05:04:57.239520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 259/499] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:57 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:57.904904 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-2b3abdcf-6d9c-4b55-9448-ac8c02fa8c33 req-410b7d32-41b4-4ba1-b624-02dee0a0c2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfddd200-54c7-46ee-9bda-5868344fcb10", "name": "network-vif-plugged", "status": "completed", "tag": "714b804c-f359-4995-a514-95d668e03a97"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:04:57.915695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2b3abdcf-6d9c-4b55-9448-ac8c02fa8c33 req-410b7d32-41b4-4ba1-b624-02dee0a0c2b5 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:57.916042 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2b3abdcf-6d9c-4b55-9448-ac8c02fa8c33 req-410b7d32-41b4-4ba1-b624-02dee0a0c2b5 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:57.929130 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-2b3abdcf-6d9c-4b55-9448-ac8c02fa8c33 req-410b7d32-41b4-4ba1-b624-02dee0a0c2b5 service nova] Creating event network-vif-plugged:714b804c-f359-4995-a514-95d668e03a97 for instance cfddd200-54c7-46ee-9bda-5868344fcb10 on hv-cinder-85057 Jul 26 05:04:57.934336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-2b3abdcf-6d9c-4b55-9448-ac8c02fa8c33 req-410b7d32-41b4-4ba1-b624-02dee0a0c2b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033175 Jul 26 05:04:57.935126 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 241/500] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:04:58.261242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:58.261827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:58.268900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:58.269387 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:58.270154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:58.270587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:58.410598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:58.419628 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-679cc2bb-6a19-45e9-8285-bf7946d2dd1d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1360 microversion: 2.1 time: 0.162388 Jul 26 05:04:58.420121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 260/501] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:58 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:04:59.450674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:04:59.451716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:04:59.461604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:59.462324 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:59.463340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:04:59.463809 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:04:59.615848 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:04:59.623751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-37c00dee-d338-4709-9180-bdeb97b2c975 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1360 microversion: 2.1 time: 0.180510 Jul 26 05:04:59.624350 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 242/502] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:04:59 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:00.645153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:00.645720 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:00.648229 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:00.648894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:00.655352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:00.655835 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:00.656604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:00.657026 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:00.809935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:00.818435 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-291dbe0c-eb24-40ef-b10e-686e536e4632 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1546 microversion: 2.1 time: 0.177358 Jul 26 05:05:00.819011 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 261/503] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:00 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:00.839487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5d450c70-61b7-4745-96d3-d3c8d30fb3ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:00.840121 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5d450c70-61b7-4745-96d3-d3c8d30fb3ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:00.841966 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:00.847917 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d450c70-61b7-4745-96d3-d3c8d30fb3ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:00.848353 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d450c70-61b7-4745-96d3-d3c8d30fb3ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:00.849193 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d450c70-61b7-4745-96d3-d3c8d30fb3ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:00.849612 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d450c70-61b7-4745-96d3-d3c8d30fb3ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:00.927610 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5d450c70-61b7-4745-96d3-d3c8d30fb3ea tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092152 Jul 26 05:05:00.928228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 243/504] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:05:00 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:01.909233 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-2f28571c-5fc4-497b-bccb-93e6bdf71fc5 req-437eefa5-0034-4d9c-93a3-84c2106eb6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfddd200-54c7-46ee-9bda-5868344fcb10", "tag": "714b804c-f359-4995-a514-95d668e03a97"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:01.920147 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2f28571c-5fc4-497b-bccb-93e6bdf71fc5 req-437eefa5-0034-4d9c-93a3-84c2106eb6ba service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:01.920580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2f28571c-5fc4-497b-bccb-93e6bdf71fc5 req-437eefa5-0034-4d9c-93a3-84c2106eb6ba service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:01.931690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-2f28571c-5fc4-497b-bccb-93e6bdf71fc5 req-437eefa5-0034-4d9c-93a3-84c2106eb6ba service nova] Creating event network-changed:714b804c-f359-4995-a514-95d668e03a97 for instance cfddd200-54c7-46ee-9bda-5868344fcb10 on hv-cinder-85057 Jul 26 05:05:01.938741 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-2f28571c-5fc4-497b-bccb-93e6bdf71fc5 req-437eefa5-0034-4d9c-93a3-84c2106eb6ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033320 Jul 26 05:05:01.939505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 262/505] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:15.094884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:15.095677 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=20 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:15.100013 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:15.100526 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:15.108361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:15.108796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:15.109542 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:15.109954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:15.199697 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lazy-loading 'services' on Instance uuid d8ea2890-2edd-445f-a103-85febb5cee98 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:05:15.278393 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-69399c3b-3139-429e-8cfa-5303b2bc1e1c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments/9ec79260-e3a6-4daf-9f3e-db30a9053f7a" status: 202 len: 0 microversion: 2.1 time: 0.184808 Jul 26 05:05:15.278994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 244/506] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:05:15 2022] DELETE /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments/9ec79260-e3a6-4daf-9f3e-db30a9053f7a => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:05:15.286610 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=14 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:15.287291 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=16 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:15.291796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9086f569-8b5d-4ded-81ab-afc364fbe8d1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:15.294247 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9086f569-8b5d-4ded-81ab-afc364fbe8d1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:15.302309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9086f569-8b5d-4ded-81ab-afc364fbe8d1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:15.302738 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9086f569-8b5d-4ded-81ab-afc364fbe8d1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:15.303524 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9086f569-8b5d-4ded-81ab-afc364fbe8d1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:15.303985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9086f569-8b5d-4ded-81ab-afc364fbe8d1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:15.335874 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9086f569-8b5d-4ded-81ab-afc364fbe8d1 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050774 Jul 26 05:05:15.336444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 263/507] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:05:15 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:16.349240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-35a6c00b-65f9-4d05-ada3-1c0c33f5c59b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:16.351580 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-35a6c00b-65f9-4d05-ada3-1c0c33f5c59b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:16.358067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35a6c00b-65f9-4d05-ada3-1c0c33f5c59b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:16.358523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35a6c00b-65f9-4d05-ada3-1c0c33f5c59b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:16.359307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35a6c00b-65f9-4d05-ada3-1c0c33f5c59b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:16.359769 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35a6c00b-65f9-4d05-ada3-1c0c33f5c59b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:16.390017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-35a6c00b-65f9-4d05-ada3-1c0c33f5c59b tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Jul 26 05:05:16.390604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 245/508] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:05:16 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:17.404255 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d26348d1-6fbd-405e-b0ab-cb849280ac9f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:17.406514 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d26348d1-6fbd-405e-b0ab-cb849280ac9f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:17.413504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d26348d1-6fbd-405e-b0ab-cb849280ac9f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:17.413949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d26348d1-6fbd-405e-b0ab-cb849280ac9f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.414729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d26348d1-6fbd-405e-b0ab-cb849280ac9f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:17.415164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d26348d1-6fbd-405e-b0ab-cb849280ac9f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.446880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d26348d1-6fbd-405e-b0ab-cb849280ac9f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048066 Jul 26 05:05:17.447451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 264/509] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:05:17 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:05:17.537239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:17.537782 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:17.544401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:17.544984 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.545741 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:17.546165 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.571679 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:05:17.655270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-efd936a7-8d1a-4f19-801b-425b9509937e tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 204 len: 0 microversion: 2.1 time: 0.121377 Jul 26 05:05:17.655948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 246/510] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:05:17 2022] DELETE /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:05:17.664287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:17.664894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:17.671300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:17.671814 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.672582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:17.673004 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:17.819447 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:17.827586 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b8cc63e4-5da8-4bc8-a86b-1c1905627d97 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1690 microversion: 2.1 time: 0.167235 Jul 26 05:05:17.828218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 265/511] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:17 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:18.854882 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:18.856052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:18.866188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:18.866632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:18.867402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:18.867864 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:19.005305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:19.013074 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-56397bcf-c0bb-4121-91b2-5cc8dd0fa0f4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1690 microversion: 2.1 time: 0.166026 Jul 26 05:05:19.013687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 247/512] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:18 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:20.037047 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:20.037663 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:20.044707 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:20.045152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:20.045921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:20.046357 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:20.201176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:20.209785 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f7617649-f112-4573-88fc-7e55c56b01bf tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1690 microversion: 2.1 time: 0.178741 Jul 26 05:05:20.210352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 266/513] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:20 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:21.233847 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:21.234456 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:21.244145 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.244592 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.245383 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.245807 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.419799 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:21.427902 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2038d7ef-e2f4-4199-8b99-352a7f8ceaff tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1690 microversion: 2.1 time: 0.200294 Jul 26 05:05:21.428477 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 248/514] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:21 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:21.952398 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-74deb18d-d3b1-4df0-a92e-afc932301359 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:21.952938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-74deb18d-d3b1-4df0-a92e-afc932301359 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:21.959816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74deb18d-d3b1-4df0-a92e-afc932301359 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.960267 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74deb18d-d3b1-4df0-a92e-afc932301359 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.961042 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74deb18d-d3b1-4df0-a92e-afc932301359 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:21.961471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74deb18d-d3b1-4df0-a92e-afc932301359 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:21.989153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-74deb18d-d3b1-4df0-a92e-afc932301359 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/ips" status: 200 len: 150 microversion: 2.20 time: 0.102628 Jul 26 05:05:21.989713 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 267/515] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Jul 26 05:05:21 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:05:22.239735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-7d54e955-8aba-4672-83f3-c7e0b500667b req-12abcf66-09ef-4708-a703-7c82a06f90c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ea2890-2edd-445f-a103-85febb5cee98", "name": "network-vif-deleted", "tag": "d1799624-13c2-451d-96a9-a79751ea030c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:22.250041 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-7d54e955-8aba-4672-83f3-c7e0b500667b req-12abcf66-09ef-4708-a703-7c82a06f90c1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.250502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-7d54e955-8aba-4672-83f3-c7e0b500667b req-12abcf66-09ef-4708-a703-7c82a06f90c1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.284137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-7d54e955-8aba-4672-83f3-c7e0b500667b req-12abcf66-09ef-4708-a703-7c82a06f90c1 service nova] Creating event network-vif-deleted:d1799624-13c2-451d-96a9-a79751ea030c for instance d8ea2890-2edd-445f-a103-85febb5cee98 on hv-cinder-85057 Jul 26 05:05:22.292108 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-7d54e955-8aba-4672-83f3-c7e0b500667b req-12abcf66-09ef-4708-a703-7c82a06f90c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055938 Jul 26 05:05:22.297315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 249/516] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:05:22.449377 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:22.449992 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:22.456722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.457140 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.458142 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.458548 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.498703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:22.499116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:22.499606 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lazy-loading 'fault' on Instance uuid d8ea2890-2edd-445f-a103-85febb5cee98 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:05:22.540664 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:22.548811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7c7b92c4-b39a-4bc4-b4ed-188608f60db8 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 200 len: 1335 microversion: 2.1 time: 0.103426 Jul 26 05:05:22.549385 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 268/517] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:22 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:23.570710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:23.571512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: d8ea2890-2edd-445f-a103-85febb5cee98] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:23.578014 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:23.578462 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:23.579226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:23.579699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:23.593511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] HTTP exception thrown: Instance d8ea2890-2edd-445f-a103-85febb5cee98 could not be found. Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Request method failure captured: Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 HTTP/1.1 Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TppTZEIzE22-l0k1qVXQWFi1a4JpacOX6I-ukPvNKWTV4LGXoFjlyR-pLI_c381psvsgMHG-u3LvGb0svyIeLIyuUv9BMz_8zzxmMG2arWGttFKsDh22CIjO14XDEMubNks0nJxAMMTXQ83lZ7CLF6KWj8TGQFie_JksEnHe0O0bM Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:05:23.595139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}] Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f0cc1af7d7d642889a1a11103f087e79 Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance d8ea2890-2edd-445f-a103-85febb5cee98 could not be found. Jul 26 05:05:23.596737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'd8ea2890-2edd-445f-a103-85febb5cee98'} Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ea2890-2edd-445f-a103-85febb5cee98 could not be found. Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:05:23.597691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ea2890-2edd-445f-a103-85febb5cee98 could not be found. Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ea2890-2edd-445f-a103-85febb5cee98 could not be found. Jul 26 05:05:23.599278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:23.600648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Returning 404 to user: Instance d8ea2890-2edd-445f-a103-85febb5cee98 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:05:23.600648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6b6289c3-22a1-4e9a-aecb-c7cec2426135 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98" status: 404 len: 111 microversion: 2.1 time: 0.030647 Jul 26 05:05:23.600648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 250/518] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:23 2022] GET /compute/v2.1/servers/d8ea2890-2edd-445f-a103-85febb5cee98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:05:23.605800 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ec4b1be7-947f-45c5-934c-ec44880ceec4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '.version_select at 0x7f0e959d09d0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:23.628968 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ec4b1be7-947f-45c5-934c-ec44880ceec4 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043573485" status: 202 len: 0 microversion: 2.1 time: 0.027048 Jul 26 05:05:23.629557 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 269/519] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Jul 26 05:05:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043573485 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:05:24.077796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:24.078325 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:24.084881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.085401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.086159 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.086562 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.109728 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lazy-loading 'flavor' on Instance uuid e2e577df-08fa-4428-a9a2-44458ca27e2a {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:05:24.345899 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-89677a6d-7112-4e76-bef3-a9dcb1bbfe0e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/action" status: 202 len: 0 microversion: 2.20 time: 0.271799 Jul 26 05:05:24.346537 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 251/520] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Jul 26 05:05:24 2022] POST /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:05:24.356682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:24.357343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:24.366401 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.367119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.368189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:24.368686 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:24.506942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:24.515594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:24.517104 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:24.518252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-03fc64f6-7fc1-476a-850d-62e93991342f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.166454 Jul 26 05:05:24.518808 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 270/521] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:24 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:25.542831 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:25.543579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:25.551420 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:25.552984 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:25.553915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:25.554296 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:25.700536 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:25.708822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:25.710364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:25.711593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-94aa867e-631a-4d5d-9aba-dea208077b60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.173744 Jul 26 05:05:25.712140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 252/522] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:25 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:26.558567 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:26.559880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:26.567510 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.567991 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.568774 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.569199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.595000 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:05:26.675826 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dd300684-1ea4-48cc-a376-56392ecd56e2 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 204 len: 0 microversion: 2.1 time: 0.120772 Jul 26 05:05:26.676451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 271/523] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:05:26 2022] DELETE /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:05:26.684831 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:26.685554 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:26.693034 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.693473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.694228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.694654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.738592 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:26.739667 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:26.748133 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.748571 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.749324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:26.750344 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:26.925900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:26.929361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:26.934380 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:26.935895 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:26.937054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ab811b4b-20f3-496d-aaa1-c863aecfc905 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.205349 Jul 26 05:05:26.937186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5e0c9d6b-9a54-4cfe-8784-df6e68a5ba6f tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1507 microversion: 2.1 time: 0.256293 Jul 26 05:05:26.937740 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 272/524] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:26 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:26.937890 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 253/525] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:26 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:27.961248 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:27.961852 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:27.962197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:27.962300 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:27.968656 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:27.968851 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:27.969093 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:27.969256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:27.969858 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:27.970000 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:27.970279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:27.970434 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:28.168580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:28.172569 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:28.176825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3ec5e70d-2c9a-46db-a1f4-d741f5c055f0 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1507 microversion: 2.1 time: 0.219696 Jul 26 05:05:28.177412 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 273/526] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:27 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:28.181261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:28.182754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:28.183946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-40d1a87a-5489-47ea-8802-00bb144c50f6 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.226324 Jul 26 05:05:28.184486 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 254/527] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:27 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:29.198508 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:29.199114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:29.205966 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:29.206413 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:29.207189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:29.207791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:29.208527 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:29.209140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:29.216698 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:29.217132 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:29.218318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:29.218759 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:29.746478 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:29.754735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:29.754927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-08205c61-6326-4375-8b5b-1ac2159a7702 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 200 len: 1507 microversion: 2.1 time: 0.560195 Jul 26 05:05:29.755727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 274/528] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:29 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 1507 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:29.765532 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:29.767039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:29.768415 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f95233b5-0caa-4a85-9c2e-e173c826e729 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.564247 Jul 26 05:05:29.768816 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 255/529] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:29 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:30.023199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-62211425-22ec-4ddd-a4cd-f569b0fecfd2 req-29ae0e50-a991-400e-9b65-1f20bde7e6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b20933-1aa3-4f28-9d7b-2482564c6c03", "name": "network-vif-deleted", "tag": "b559b234-be1a-4b1e-9174-8e074a42caaf"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:30.033401 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-62211425-22ec-4ddd-a4cd-f569b0fecfd2 req-29ae0e50-a991-400e-9b65-1f20bde7e6ac service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.033837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-62211425-22ec-4ddd-a4cd-f569b0fecfd2 req-29ae0e50-a991-400e-9b65-1f20bde7e6ac service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.045580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-62211425-22ec-4ddd-a4cd-f569b0fecfd2 req-29ae0e50-a991-400e-9b65-1f20bde7e6ac service nova] Creating event network-vif-deleted:b559b234-be1a-4b1e-9174-8e074a42caaf for instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 on hv-cinder-85057 Jul 26 05:05:30.050323 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-62211425-22ec-4ddd-a4cd-f569b0fecfd2 req-29ae0e50-a991-400e-9b65-1f20bde7e6ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Jul 26 05:05:30.050955 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 275/530] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:30.776563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:30.777206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: c4b20933-1aa3-4f28-9d7b-2482564c6c03] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:30.784416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.784861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.785738 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.786169 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.792901 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:30.793591 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:30.799939 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] HTTP exception thrown: Instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 could not be found. Jul 26 05:05:30.800105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.800882 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Request method failure captured: Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 HTTP/1.1 Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TppTZEIzE22-l0k1qVXQWFi1a4JpacOX6I-ukPvNKWTV4LGXoFjlyR-pLI_c381psvsgMHG-u3LvGb0svyIeLIyuUv9BMz_8zzxmMG2arWGttFKsDh22CIjO14XDEMubNks0nJxAMMTXQ83lZ7CLF6KWj8TGQFie_JksEnHe0O0bM Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:05:30.801643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}] Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f0cc1af7d7d642889a1a11103f087e79 Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 could not be found. Jul 26 05:05:30.803189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'c4b20933-1aa3-4f28-9d7b-2482564c6c03'} Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 could not be found. Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:05:30.804201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 could not be found. Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 could not be found. Jul 26 05:05:30.805802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:30.807474 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.807474 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.807673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Returning 404 to user: Instance c4b20933-1aa3-4f28-9d7b-2482564c6c03 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:05:30.807673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8f79f1c3-0b84-4f24-b342-b0f06be63f2a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03" status: 404 len: 111 microversion: 2.1 time: 0.030484 Jul 26 05:05:30.807673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 256/531] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:30 2022] GET /compute/v2.1/servers/c4b20933-1aa3-4f28-9d7b-2482564c6c03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:05:30.811289 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:30.811830 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:30.818240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.818593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.819392 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.819841 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.845321 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:05:30.859696 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:30.922745 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3318d824-0272-46ed-88bc-6307fc5d6aec tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 204 len: 0 microversion: 2.1 time: 0.114734 Jul 26 05:05:30.923613 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 257/532] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:05:30 2022] DELETE /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:05:30.931926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:30.932948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:30.938733 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.939582 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.940332 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:30.940747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:30.946463 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:30.954574 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:30.956127 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:30.957518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-19d21a1e-fe57-47aa-a6b8-743b82336591 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.169344 Jul 26 05:05:30.958088 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 276/533] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:30 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:31.078487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:31.086140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-64a2f8fb-7818-482b-93ce-3ecc20d7e6a6 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.158382 Jul 26 05:05:31.086720 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 258/534] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:30 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:05:31.982343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:31.982926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:31.989935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:31.990371 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:31.991133 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:31.991577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:32.107538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:32.108249 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:32.115648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:32.116159 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:32.116991 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:32.117485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:32.126984 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:32.135245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:32.136750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:32.137902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6dd79b86-216c-473b-8f3a-c5d35b6e6dc2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.159566 Jul 26 05:05:32.138460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 277/535] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:31 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:32.262341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:32.270575 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-adbcd866-1118-4517-8620-55831588e13d tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.167007 Jul 26 05:05:32.271167 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 259/536] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:32 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:33.164150 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:33.164750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:33.171985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:33.172413 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:33.173185 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:33.173634 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:33.292034 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:33.292632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:33.299272 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:33.299760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:33.300523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:33.301095 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:33.310895 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:33.319602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:33.321336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:33.322769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2a41e245-a16e-4d9f-9dfd-6c0b3d52919b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.162602 Jul 26 05:05:33.323360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 278/537] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:33 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:33.439483 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:33.448441 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1ca5ccec-b16f-446f-aca1-581fbf4ac625 tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.160421 Jul 26 05:05:33.449018 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 260/538] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:33 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:05:34.348281 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:34.348852 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:34.355907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:34.356348 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:34.357158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:34.357560 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:34.376268 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:34.477525 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:34.478171 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:34.485073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:34.485547 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:34.486316 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:34.486747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:34.653370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:34.661820 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:34.663276 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:34.664501 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-38d8d47c-222d-4490-b839-7b4671c32651 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.322428 Jul 26 05:05:34.679751 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 279/539] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:34 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:34.733001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0cc1af7d7d642889a1a11103f087e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c772e5c90114978ad92818d58ca11c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:34.740927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-641b04a2-1900-42aa-9e5e-927b597a170a tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 200 len: 1521 microversion: 2.1 time: 0.267255 Jul 26 05:05:34.741557 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 261/540] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:34 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:34.974266 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-8f64cac4-9634-4315-9357-cc1510b71e76 req-f19ae10c-0150-4f90-8f31-cbe18351de1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f4c17ac-a751-4ebc-9a68-b051d32dc63f", "name": "network-vif-deleted", "tag": "ad83218c-f197-497a-8169-9fcae83efaee"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:34.983855 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8f64cac4-9634-4315-9357-cc1510b71e76 req-f19ae10c-0150-4f90-8f31-cbe18351de1f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:34.984288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8f64cac4-9634-4315-9357-cc1510b71e76 req-f19ae10c-0150-4f90-8f31-cbe18351de1f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:34.995352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-8f64cac4-9634-4315-9357-cc1510b71e76 req-f19ae10c-0150-4f90-8f31-cbe18351de1f service nova] Creating event network-vif-deleted:ad83218c-f197-497a-8169-9fcae83efaee for instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f on hv-cinder-85057 Jul 26 05:05:35.000160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-8f64cac4-9634-4315-9357-cc1510b71e76 req-f19ae10c-0150-4f90-8f31-cbe18351de1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029727 Jul 26 05:05:35.000744 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 280/541] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:35.689746 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:35.690357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:35.697756 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:35.698194 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:35.698941 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:35.699364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:35.762813 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:35.763374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] [instance: 3f4c17ac-a751-4ebc-9a68-b051d32dc63f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:35.770271 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:35.771686 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:35.772452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:35.772913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:35.786746 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] HTTP exception thrown: Instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f could not be found. Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Request method failure captured: Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f HTTP/1.1 Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TppTZEIzE22-l0k1qVXQWFi1a4JpacOX6I-ukPvNKWTV4LGXoFjlyR-pLI_c381psvsgMHG-u3LvGb0svyIeLIyuUv9BMz_8zzxmMG2arWGttFKsDh22CIjO14XDEMubNks0nJxAMMTXQ83lZ7CLF6KWj8TGQFie_JksEnHe0O0bM Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:05:35.788417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1c772e5c90114978ad92818d58ca11c2"}]}] Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 1c772e5c90114978ad92818d58ca11c2 Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-630643721 Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: f0cc1af7d7d642889a1a11103f087e79 Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-630643721-project Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f could not be found. Jul 26 05:05:35.789829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '3f4c17ac-a751-4ebc-9a68-b051d32dc63f'} Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f could not be found. Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:05:35.790627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f could not be found. Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f could not be found. Jul 26 05:05:35.792488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:05:35.793566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] Returning 404 to user: Instance 3f4c17ac-a751-4ebc-9a68-b051d32dc63f could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:05:35.793566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d74d5b4f-e9c1-42a3-a23a-3295e1e0320c tempest-ServerRescueNegativeTestJSON-630643721 tempest-ServerRescueNegativeTestJSON-630643721-project] 10.222.0.17 "GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f" status: 404 len: 111 microversion: 2.1 time: 0.031930 Jul 26 05:05:35.793566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 281/542] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:35 2022] GET /compute/v2.1/servers/3f4c17ac-a751-4ebc-9a68-b051d32dc63f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:05:35.847499 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:35.855863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:35.857385 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:35.858543 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-51eb7036-bc75-4833-a764-26573e7126a8 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.173240 Jul 26 05:05:35.859125 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 262/543] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:35 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:36.881791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:36.882372 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:36.889564 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.890263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:36.891020 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:36.891454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:37.115649 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:37.124448 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:37.125934 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:37.127083 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-90f53f4c-7e76-4a3f-9355-07734c6ce14a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.249433 Jul 26 05:05:37.127862 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 282/544] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:36 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:38.151251 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:38.152650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:38.159784 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:38.160414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:38.161256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:38.161918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:38.482707 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:38.491611 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:38.493115 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:38.494286 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ce30ae33-afca-4886-b0bb-e9a91ca83ced tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.347658 Jul 26 05:05:38.494847 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 263/545] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:38 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:39.521730 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:39.522430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:39.529791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:39.530326 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:39.531167 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:39.531694 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:39.681077 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:39.690567 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:39.692231 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:39.693404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-84ac5f7b-2d77-4924-b100-3193fc7e0389 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.175748 Jul 26 05:05:39.693945 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 283/546] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:39 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:40.716711 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:40.717305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:40.724559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:40.724999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:40.725756 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:40.726180 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:40.863193 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:40.871448 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:40.872994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:40.874182 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-40d140cb-de01-407f-a611-edd418b13c0a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.161454 Jul 26 05:05:40.874762 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 264/547] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:40 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:05:41.898621 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:41.899386 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:41.907968 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:41.908592 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:41.909819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:41.910480 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:42.047488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:42.056088 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:42.057616 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:42.058791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-633dfbf4-35d0-4973-ba87-19e2ddfacbb2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.164502 Jul 26 05:05:42.059332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 284/548] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:41 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:43.082707 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:43.083288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:43.090654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:43.091104 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:43.091911 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:43.092342 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:43.234744 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:43.243061 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:43.244871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:43.246223 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1f7d4754-b0d3-4874-bfb9-94c14e5cf2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.167576 Jul 26 05:05:43.247029 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 265/549] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:43 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:44.270347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:44.270938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:44.277811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:44.278251 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:44.279074 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:44.279472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:44.414991 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:44.423490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:44.425019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:44.426255 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8809faca-c386-4e6c-820e-15c218d07bf1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.159849 Jul 26 05:05:44.426818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 285/550] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:44 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:45.450185 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:45.450851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:45.453401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:45.461853 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:45.462303 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:45.463104 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:45.463511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:45.602496 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:45.613952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:45.616167 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:45.617735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cba02376-3add-4650-8e9b-7c86ba67f107 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1744 microversion: 2.20 time: 0.171461 Jul 26 05:05:45.631583 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 266/551] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:45 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:45.757743 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8f691b81-dd35-4f53-b09a-d55ca9009b95 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:45.758255 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8f691b81-dd35-4f53-b09a-d55ca9009b95 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:45.760346 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:45.766034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f691b81-dd35-4f53-b09a-d55ca9009b95 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:45.766547 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f691b81-dd35-4f53-b09a-d55ca9009b95 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:45.767311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f691b81-dd35-4f53-b09a-d55ca9009b95 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:45.767761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8f691b81-dd35-4f53-b09a-d55ca9009b95 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:45.792151 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8f691b81-dd35-4f53-b09a-d55ca9009b95 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/ips" status: 200 len: 145 microversion: 2.1 time: 0.215659 Jul 26 05:05:45.793086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 286/552] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:05:45 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/ips => generated 145 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:46.641616 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:46.642217 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:46.649140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:46.649584 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:46.650349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:46.650778 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:46.801427 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:46.810453 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:46.812132 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:46.813789 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b08f58e9-1f3f-4d00-873f-10b4c7443172 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1744 microversion: 2.20 time: 0.175962 Jul 26 05:05:46.814645 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 267/553] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:46 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:47.160375 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-79c23e71-7972-43cc-8fc2-ed242b3f1944 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9765173e-9953-4128-b750-2bd2e389e261"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:47.162830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-79c23e71-7972-43cc-8fc2-ed242b3f1944 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:47.169411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79c23e71-7972-43cc-8fc2-ed242b3f1944 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:47.169865 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79c23e71-7972-43cc-8fc2-ed242b3f1944 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:47.170647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79c23e71-7972-43cc-8fc2-ed242b3f1944 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:47.171067 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79c23e71-7972-43cc-8fc2-ed242b3f1944 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:47.472390 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-79c23e71-7972-43cc-8fc2-ed242b3f1944 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316174 Jul 26 05:05:47.473672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 287/554] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:05:47 2022] POST /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:47.837069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:47.838307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:47.847166 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:47.847639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:47.848467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:47.848909 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:48.062481 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:48.088990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:48.094942 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:48.096205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a28b086c-e95d-4b4d-81f1-2ba7312fa27d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.263346 Jul 26 05:05:48.111832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 268/555] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:47 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:05:49.132281 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:49.133812 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:49.145142 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:49.145599 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:49.146399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:49.146835 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:49.329807 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:49.339079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:49.341064 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:49.342599 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-70bcfe1a-000a-49e6-bb11-3e2e0d31f4a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.214969 Jul 26 05:05:49.343359 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 288/556] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:49 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:50.204502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-d67b59bd-b63e-4289-892a-58a6fa2f234f req-b571fa99-d9a3-43ad-857b-9d7920ffb351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e577df-08fa-4428-a9a2-44458ca27e2a", "name": "network-vif-plugged", "status": "completed", "tag": "19c54117-94e3-4ff4-a8ce-06b6514cd2e6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:50.217886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-d67b59bd-b63e-4289-892a-58a6fa2f234f req-b571fa99-d9a3-43ad-857b-9d7920ffb351 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:50.218670 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-d67b59bd-b63e-4289-892a-58a6fa2f234f req-b571fa99-d9a3-43ad-857b-9d7920ffb351 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:50.232179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-d67b59bd-b63e-4289-892a-58a6fa2f234f req-b571fa99-d9a3-43ad-857b-9d7920ffb351 service nova] Creating event network-vif-plugged:19c54117-94e3-4ff4-a8ce-06b6514cd2e6 for instance e2e577df-08fa-4428-a9a2-44458ca27e2a on hv-cinder-85057 Jul 26 05:05:50.238040 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-d67b59bd-b63e-4289-892a-58a6fa2f234f req-b571fa99-d9a3-43ad-857b-9d7920ffb351 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038243 Jul 26 05:05:50.239099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 269/557] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:50.371994 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:50.372696 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:50.381312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:50.381768 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:50.382621 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:50.383501 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:50.534685 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:50.546986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:50.548632 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:50.550374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3fa91ce5-8d0c-4f94-9d0d-c98aefab7c82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.183232 Jul 26 05:05:50.551454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 289/558] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:50 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:51.575282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:51.576004 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:51.585266 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:51.586183 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:51.586961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:51.587390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:51.758450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:51.769999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:51.771593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:51.772977 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2801ee4a-6f75-424b-822a-114b604d7232 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.202282 Jul 26 05:05:51.773911 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 270/559] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:51 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:52.796364 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:52.796973 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:52.804233 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:52.805342 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:52.806783 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:52.807811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:53.027617 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:53.056015 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:53.057515 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:53.058836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a05cddd0-1e96-4e32-8059-e8674e1f41dc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.266963 Jul 26 05:05:53.067400 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 290/560] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:52 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:54.083232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:54.084460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:54.094446 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:54.095721 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:54.097299 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:54.097726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:54.129037 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:54.129582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:54.143733 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:54.148286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:54.149335 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:54.149836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:54.217602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:05:54.352370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c07dbd62-d8d2-4c19-83f1-61e08b5c4f6c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 204 len: 0 microversion: 2.1 time: 0.226951 Jul 26 05:05:54.353621 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 291/561] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:05:54 2022] DELETE /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:05:54.364306 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:54.365665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:54.375898 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:54.380065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:54.382346 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:54.383330 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:54.385444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:54.394080 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:54.400502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:54.402277 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2abd0f49-9d0d-4c2d-8c80-3bfca13ada94 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.323045 Jul 26 05:05:54.403422 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 271/562] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:54 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:05:54.547027 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:54.555538 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ac1c35a0-5bd8-4ee1-ad67-e5eea5e81341 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1578 microversion: 2.1 time: 0.197728 Jul 26 05:05:54.556332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 292/563] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:54 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1578 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:05:55.240063 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c37e68d9-273b-4551-8e9f-f29ab5beafb3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:55.249676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c37e68d9-273b-4551-8e9f-f29ab5beafb3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:55.257791 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c37e68d9-273b-4551-8e9f-f29ab5beafb3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.258534 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c37e68d9-273b-4551-8e9f-f29ab5beafb3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.275808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c37e68d9-273b-4551-8e9f-f29ab5beafb3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.276844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c37e68d9-273b-4551-8e9f-f29ab5beafb3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.344298 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c37e68d9-273b-4551-8e9f-f29ab5beafb3 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108598 Jul 26 05:05:55.349219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 272/564] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:05:55 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:55.357857 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f1356d1e-6ffd-405d-96bf-a00973e32a63 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:55.358399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f1356d1e-6ffd-405d-96bf-a00973e32a63 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:55.366101 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1356d1e-6ffd-405d-96bf-a00973e32a63 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.366620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1356d1e-6ffd-405d-96bf-a00973e32a63 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.372504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1356d1e-6ffd-405d-96bf-a00973e32a63 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.373370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f1356d1e-6ffd-405d-96bf-a00973e32a63 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.423061 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f1356d1e-6ffd-405d-96bf-a00973e32a63 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/9765173e-9953-4128-b750-2bd2e389e261" status: 200 len: 194 microversion: 2.1 time: 0.070734 Jul 26 05:05:55.424236 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 293/565] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Jul 26 05:05:55 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/9765173e-9953-4128-b750-2bd2e389e261 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:55.429470 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:55.430076 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:55.445134 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.445862 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.446840 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.447726 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.578225 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:55.578837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:55.592379 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.593106 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.594076 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:55.595059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:55.623544 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:55.627513 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:55.636656 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:55.638718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:55.640011 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7da5a1b4-28b8-470f-8656-f7c52b1190cc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.215054 Jul 26 05:05:55.640617 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 273/566] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:55 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:05:55.780117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:55.784888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:55.793277 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ffd38455-a635-4a9a-8bb6-c0e9e961fb09 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1578 microversion: 2.1 time: 0.219070 Jul 26 05:05:55.794241 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 294/567] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:55 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:56.664722 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:56.665950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:56.673691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:56.674520 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:56.675679 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:56.676358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:56.862527 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:56.864468 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:56.874471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:56.875139 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:56.876167 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:56.876932 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:56.999304 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:57.007524 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c793f00d-8095-457c-80a9-72d1eb3ce4ad tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1510 microversion: 2.1 time: 0.149454 Jul 26 05:05:57.008264 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 295/568] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:56 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:57.013083 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e0b9b7fd-0946-4163-929b-98fd680b2973 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb5e864e-e7d2-4c29-9bc0-1824a06bceac"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:57.015522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e0b9b7fd-0946-4163-929b-98fd680b2973 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:57.021868 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0b9b7fd-0946-4163-929b-98fd680b2973 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:57.022320 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0b9b7fd-0946-4163-929b-98fd680b2973 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:57.023093 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0b9b7fd-0946-4163-929b-98fd680b2973 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:57.023526 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0b9b7fd-0946-4163-929b-98fd680b2973 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:57.063082 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:57.072189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:57.074009 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:57.075255 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b3bc8b6d-cd8e-466c-959e-5cd557a3b3e2 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1739 microversion: 2.20 time: 0.414682 Jul 26 05:05:57.076098 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 274/569] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:56 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:05:57.398402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-1387656c-7fb4-45ca-8c06-0b3f304540b4 req-04af2e92-e73e-4ed8-b86a-22ca4ae34916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72962b6-f3c4-41b4-96fd-5045b03faf2a", "name": "network-vif-deleted", "tag": "6cf9eff0-8091-47a1-b175-0369e3eb4648"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:57.422092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-1387656c-7fb4-45ca-8c06-0b3f304540b4 req-04af2e92-e73e-4ed8-b86a-22ca4ae34916 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:57.422541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-1387656c-7fb4-45ca-8c06-0b3f304540b4 req-04af2e92-e73e-4ed8-b86a-22ca4ae34916 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:57.458175 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-1387656c-7fb4-45ca-8c06-0b3f304540b4 req-04af2e92-e73e-4ed8-b86a-22ca4ae34916 service nova] Creating event network-vif-deleted:6cf9eff0-8091-47a1-b175-0369e3eb4648 for instance d72962b6-f3c4-41b4-96fd-5045b03faf2a on hv-cinder-85057 Jul 26 05:05:57.464390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-1387656c-7fb4-45ca-8c06-0b3f304540b4 req-04af2e92-e73e-4ed8-b86a-22ca4ae34916 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216108 Jul 26 05:05:57.471432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 275/570] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:05:57.546566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e0b9b7fd-0946-4163-929b-98fd680b2973 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "POST /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537160 Jul 26 05:05:57.552603 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 296/571] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:05:57 2022] POST /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:05:58.029770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:58.030476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:58.039611 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:58.040155 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:58.041770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:58.042561 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:58.083940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:58.084462 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:58.084999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lazy-loading 'fault' on Instance uuid d72962b6-f3c4-41b4-96fd-5045b03faf2a {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:05:58.100888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:58.101608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:58.114338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:58.115049 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:58.116721 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:58.117682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:58.133761 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:58.141730 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aabc7f7a-7fc6-4e00-97da-149fc21d5257 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 200 len: 1230 microversion: 2.1 time: 0.116512 Jul 26 05:05:58.142548 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 276/572] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:58 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:05:58.299502 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:58.308755 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:58.310502 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:58.312554 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-34d50abf-1a91-4475-aebb-8de0f3f7bd56 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1721 microversion: 2.20 time: 0.217961 Jul 26 05:05:58.314526 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 297/573] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:58 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:05:59.170645 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:59.171755 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:59.179713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:59.180167 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:59.180963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:59.181395 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:59.194981 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] HTTP exception thrown: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Request method failure captured: Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a HTTP/1.1 Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33WJu-x6GbbTOxz9RIKRgTQ1jfnwmI1AcQhrBDRXGGKN7Alj0kqvw3xINUIv1SrND2Qt2qsW_yK6fzl8RNL4L8x28NBLPq2liGbmas_2v4WnLHVRrGlC614O_TX5_zIqFolkCd1g472FaUq67nZkDDyGKdhKN4oemxxaPB_agPUcU7k Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:05:59.196650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/987757bb89e64419822e021b15a65c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_987757bb89e64419822e021b15a65c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}] Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-TestVolumeBootPattern-506650767 Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 148ea5a9b7a74172b290696be99aa5c1 Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:05:59.198242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'd72962b6-f3c4-41b4-96fd-5045b03faf2a'} Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:05:59.199073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:05:59.200478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:05:59.201568 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Returning 404 to user: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:05:59.201568 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-04831302-e1a8-4661-a908-ce15d0beaad3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 404 len: 111 microversion: 2.1 time: 0.035331 Jul 26 05:05:59.201568 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 277/574] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:05:59 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:05:59.301816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1633465662", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-650642350", "security_groups": [{"name": "tempest-secgroup-smoke-2144158790"}], "block_device_mapping_v2": [{"uuid": "c1c5b4f8-f1e2-4b5e-9714-1b81b89f2386", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51ac167e-d2d0-4324-aecb-2b52bb6a1ed2"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:05:59.336906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:05:59.338164 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:05:59.348461 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:59.349112 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:59.350161 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:05:59.350756 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:05:59.484403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] validate_networks() for [('51ac167e-d2d0-4324-aecb-2b52bb6a1ed2', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:05:59.594483 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:59.603366 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:59.605751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:05:59.606516 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ab57bf03-2a39-487a-a654-8d2dbf00d027 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1721 microversion: 2.20 time: 0.273667 Jul 26 05:05:59.607248 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 278/575] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:05:59 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:06:00.014146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:06:00.014637 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:06:00.015111 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:06:00.015649 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:06:00.016152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:06:00.025385 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:00.025906 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:00.026792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:00.027424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:00.044152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for project 987757bb89e64419822e021b15a65c31. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:06:00.048156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for user 148ea5a9b7a74172b290696be99aa5c1 and project 987757bb89e64419822e021b15a65c31. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:06:00.109893 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:06:00.112038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1c5b4f8-f1e2-4b5e-9714-1b81b89f2386',volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:06:00.272526 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-12d74f80-ff6e-4161-a11a-62265bbe579c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.974651 Jul 26 05:06:00.273415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 298/576] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:05:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:06:00.287368 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f164618c-f3e1-4616-9550-d6974c7af649 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:00.288324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f164618c-f3e1-4616-9550-d6974c7af649 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:00.359981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f164618c-f3e1-4616-9550-d6974c7af649 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:00.370109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f164618c-f3e1-4616-9550-d6974c7af649 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1094 microversion: 2.1 time: 0.089393 Jul 26 05:06:00.371024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 299/577] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:00 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:00.492526 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-2c3df45c-13cc-41c9-b6b0-e129aed2f10f req-67e06114-ac8a-4ce9-8be0-23c60e78c08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e577df-08fa-4428-a9a2-44458ca27e2a", "name": "network-vif-unplugged", "status": "completed", "tag": "19c54117-94e3-4ff4-a8ce-06b6514cd2e6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:00.502643 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2c3df45c-13cc-41c9-b6b0-e129aed2f10f req-67e06114-ac8a-4ce9-8be0-23c60e78c08a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:00.503339 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2c3df45c-13cc-41c9-b6b0-e129aed2f10f req-67e06114-ac8a-4ce9-8be0-23c60e78c08a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:00.514540 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-2c3df45c-13cc-41c9-b6b0-e129aed2f10f req-67e06114-ac8a-4ce9-8be0-23c60e78c08a service nova] Creating event network-vif-unplugged:19c54117-94e3-4ff4-a8ce-06b6514cd2e6 for instance e2e577df-08fa-4428-a9a2-44458ca27e2a on hv-cinder-85057 Jul 26 05:06:00.519713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-2c3df45c-13cc-41c9-b6b0-e129aed2f10f req-67e06114-ac8a-4ce9-8be0-23c60e78c08a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.241698 Jul 26 05:06:00.520318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 279/578] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:00.630633 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:00.631361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:00.650119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:00.651285 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:00.651409 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:00.651796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:00.864430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:00.873829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:00.875685 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:00.876919 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2ac9bf1b-560e-415b-8318-586bda68b55a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1724 microversion: 2.20 time: 0.250504 Jul 26 05:06:00.877558 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 300/579] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:00 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:00.905408 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0192aa0c-f4f8-4508-8137-1ddc3478c2aa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d050ef43-66a4-41b1-8ee1-4ed052779db0"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:00.909006 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0192aa0c-f4f8-4508-8137-1ddc3478c2aa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:00.916468 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0192aa0c-f4f8-4508-8137-1ddc3478c2aa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:00.917267 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0192aa0c-f4f8-4508-8137-1ddc3478c2aa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:00.919827 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0192aa0c-f4f8-4508-8137-1ddc3478c2aa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:00.920439 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0192aa0c-f4f8-4508-8137-1ddc3478c2aa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.262570 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0192aa0c-f4f8-4508-8137-1ddc3478c2aa tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.363501 Jul 26 05:06:01.263297 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 280/580] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Jul 26 05:06:00 2022] POST /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-volume_attachments => generated 188 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 05:06:01.394127 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f95f49be-720d-4d7e-a143-1783f427f03c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:01.398492 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:01.399165 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:01.404844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f95f49be-720d-4d7e-a143-1783f427f03c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:01.409811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.410253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.411022 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.411480 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.419067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95f49be-720d-4d7e-a143-1783f427f03c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.419512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95f49be-720d-4d7e-a143-1783f427f03c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.420323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95f49be-720d-4d7e-a143-1783f427f03c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.420750 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f95f49be-720d-4d7e-a143-1783f427f03c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.482963 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:01.491283 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fbe056f4-6167-45a7-b338-0354e299b2d9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1136 microversion: 2.1 time: 0.103034 Jul 26 05:06:01.492105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 301/581] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:01 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1136 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:01.696671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f95f49be-720d-4d7e-a143-1783f427f03c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-volume_attachments/d050ef43-66a4-41b1-8ee1-4ed052779db0" status: 202 len: 0 microversion: 2.20 time: 0.306813 Jul 26 05:06:01.697294 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 281/582] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Jul 26 05:06:01 2022] DELETE /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-volume_attachments/d050ef43-66a4-41b1-8ee1-4ed052779db0 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:01.757433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4ccf526f-535e-4b45-bcda-9a28d853a050 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:01.757999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4ccf526f-535e-4b45-bcda-9a28d853a050 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:01.767144 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ccf526f-535e-4b45-bcda-9a28d853a050 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.767754 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ccf526f-535e-4b45-bcda-9a28d853a050 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.768714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ccf526f-535e-4b45-bcda-9a28d853a050 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.769326 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4ccf526f-535e-4b45-bcda-9a28d853a050 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.871443 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4ccf526f-535e-4b45-bcda-9a28d853a050 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "POST /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/action" status: 202 len: 0 microversion: 2.20 time: 0.117759 Jul 26 05:06:01.872216 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 302/583] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Jul 26 05:06:01 2022] POST /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:01.880658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:01.881391 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:01.888149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.888657 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:01.889479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:01.890096 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:02.150152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:02.160349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:02.162559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:02.163842 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a1b474c4-2c0f-4e88-a9db-be85e0af24fd tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1672 microversion: 2.20 time: 0.287318 Jul 26 05:06:02.175844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 282/584] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:01 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1672 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:06:02.517459 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:02.519122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:02.544381 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:02.544835 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:02.545716 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:02.550321 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:02.665996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:02.673766 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-09ba7b23-9fa5-4820-8088-e9de64694332 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1210 microversion: 2.1 time: 0.161160 Jul 26 05:06:02.674614 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 303/585] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:02 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:03.190639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:03.192267 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:03.201688 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:03.202509 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:03.203607 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:03.204043 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:03.586773 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:03.595261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:03.597076 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:03.599647 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9e6a5ee8-ac71-4b2c-a369-746b86f41a19 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1672 microversion: 2.20 time: 0.415554 Jul 26 05:06:03.600412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 283/586] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:03 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1672 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:03.700805 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:03.702299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:03.711949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:03.712686 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:03.714844 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:03.715508 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:04.077009 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:04.094020 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6eb76466-f909-4c3f-9bed-6571a254f3d3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1278 microversion: 2.1 time: 0.400460 Jul 26 05:06:04.108833 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 304/587] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:03 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1278 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:04.161838 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-a7356928-1666-49e7-af67-73fccf543b96 req-05e6773e-f56b-4420-b33f-803e63b5e807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048e3ed2-61f1-4d21-92c7-cfd8a94abb52", "tag": "74e6a160-dc8d-420e-9018-7b77f693900b"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:04.173952 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a7356928-1666-49e7-af67-73fccf543b96 req-05e6773e-f56b-4420-b33f-803e63b5e807 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:04.174422 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a7356928-1666-49e7-af67-73fccf543b96 req-05e6773e-f56b-4420-b33f-803e63b5e807 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:04.190737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-a7356928-1666-49e7-af67-73fccf543b96 req-05e6773e-f56b-4420-b33f-803e63b5e807 service nova] Creating event network-changed:74e6a160-dc8d-420e-9018-7b77f693900b for instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 on hv-cinder-85057 Jul 26 05:06:04.195700 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-a7356928-1666-49e7-af67-73fccf543b96 req-05e6773e-f56b-4420-b33f-803e63b5e807 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037687 Jul 26 05:06:04.196341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 284/588] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:04.622818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:04.623428 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:04.630181 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:04.630631 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:04.631381 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:04.631846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:04.781271 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:04.790063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:04.791610 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:04.792812 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a5fa1be1-ea37-4866-b0bb-dfad418496ee tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.174173 Jul 26 05:06:04.793379 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 305/589] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:04 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:05.127510 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:05.128813 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:05.148383 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:05.148844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:05.149649 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:05.150085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:05.203946 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1036282836", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "networks": [{"uuid": "4b557bf1-ddc6-4648-bd73-0fa056e3765b"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:05.275496 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] validate_networks() for [('4b557bf1-ddc6-4648-bd73-0fa056e3765b', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:06:05.733073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:05.741474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bbfa7382-f492-4fa4-bd32-8efed1f50b69 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1278 microversion: 2.1 time: 0.626983 Jul 26 05:06:05.742179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 285/590] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:05 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1278 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:05.747713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-de5de6db-7486-461f-86c8-e3d329da65a5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:05.749958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-de5de6db-7486-461f-86c8-e3d329da65a5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:05.756511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de5de6db-7486-461f-86c8-e3d329da65a5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:05.757035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de5de6db-7486-461f-86c8-e3d329da65a5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:05.757875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de5de6db-7486-461f-86c8-e3d329da65a5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:05.758403 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de5de6db-7486-461f-86c8-e3d329da65a5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:05.791257 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-de5de6db-7486-461f-86c8-e3d329da65a5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047235 Jul 26 05:06:05.791875 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 286/591] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:06:05 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:05.817067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:05.817821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:05.823905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:05.824345 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:05.825099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:05.825521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.167703 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:06.170119 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:06.177598 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:06.179446 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:06.180932 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4b4a7c53-8afd-4b27-9665-a5c535c9e4d3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.368143 Jul 26 05:06:06.181541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 287/592] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:05 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:06.201515 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:06:06.202476 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:06:06.203145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:06:06.203775 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:06:06.204365 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:06:06.205863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b947df43-7dd7-48f1-9e0e-0979f344bc1c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:06.206626 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b947df43-7dd7-48f1-9e0e-0979f344bc1c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:06.214872 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b947df43-7dd7-48f1-9e0e-0979f344bc1c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.215684 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b947df43-7dd7-48f1-9e0e-0979f344bc1c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.217148 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b947df43-7dd7-48f1-9e0e-0979f344bc1c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.217821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b947df43-7dd7-48f1-9e0e-0979f344bc1c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.226261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.226783 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.231143 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.231863 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.257786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b947df43-7dd7-48f1-9e0e-0979f344bc1c tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/9765173e-9953-4128-b750-2bd2e389e261" status: 200 len: 194 microversion: 2.1 time: 0.061804 Jul 26 05:06:06.258585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 288/593] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Jul 26 05:06:06 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/9765173e-9953-4128-b750-2bd2e389e261 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:06.261172 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Getting quotas for project a30ecee1cac84583bb0e1c74eb333314. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:06:06.266019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Getting quotas for user ae6d25b14db34c6392999d0f7a929772 and project a30ecee1cac84583bb0e1c74eb333314. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:06:06.270953 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:06.271442 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:06.279721 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.281975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.283311 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.283997 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.289350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:06:06.291544 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:06:06.385263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-621b220d-b936-4aad-91b5-18ba057ad550 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185196 Jul 26 05:06:06.392888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 306/594] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:06:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 05:06:06.401694 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-329025b9-e8c8-43ec-a8a9-ed82787dc7a6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:06.406935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-329025b9-e8c8-43ec-a8a9-ed82787dc7a6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:06.443330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lazy-loading 'services' on Instance uuid cfddd200-54c7-46ee-9bda-5868344fcb10 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:06.503620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-329025b9-e8c8-43ec-a8a9-ed82787dc7a6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:06.512210 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-329025b9-e8c8-43ec-a8a9-ed82787dc7a6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1214 microversion: 2.1 time: 0.115492 Jul 26 05:06:06.515811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 307/595] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:06 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:06.596592 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aa505bec-53b3-484e-ab3f-f1c48a21efac tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/9765173e-9953-4128-b750-2bd2e389e261" status: 202 len: 0 microversion: 2.1 time: 0.330000 Jul 26 05:06:06.597771 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 289/596] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:06:06 2022] DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/9765173e-9953-4128-b750-2bd2e389e261 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:06:06.762917 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:06.764131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:06.771242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.771724 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.772544 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:06.772974 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:06.951380 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:06.959168 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2446eb94-b06f-4921-a31e-0e65d0d9e0b1 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.200524 Jul 26 05:06:06.959822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 308/597] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:06 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:07.210154 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:07.212724 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:07.221132 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.221906 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:07.222836 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.223261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:07.366261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:07.374592 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:07.376134 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:07.377305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2336743b-cc39-4398-9544-a57b264c2c5d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.172020 Jul 26 05:06:07.378325 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 290/598] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:07 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:06:07.534017 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:07.534902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:07.541665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.543284 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:07.543284 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.543603 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:07.608248 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:07.618006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c963466a-2b6c-4ee6-80c6-c6035088b79a tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.088071 Jul 26 05:06:07.618600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 309/599] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:07 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:07.980651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:07.981259 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:07.988045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.988498 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:07.989262 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:07.989695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:08.135000 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:08.140790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6c9c0ed3-5346-42e5-8e25-abbf48df157b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.164005 Jul 26 05:06:08.154788 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 291/600] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:07 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:08.402302 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:08.403028 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:08.410531 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:08.410983 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:08.411804 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:08.412421 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:08.556830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:08.566050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:08.567619 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:08.568827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2c8bd604-7799-49f3-95b3-5465d268d1da tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.170516 Jul 26 05:06:08.569433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 310/601] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:08 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:08.641309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:08.642712 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:08.649926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:08.650787 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:08.651592 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:08.652067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:08.716649 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:08.724710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-17e38aab-6204-4e74-9ca0-6e612f0c8744 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.088770 Jul 26 05:06:08.730588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 292/602] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:08 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:09.163872 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:09.164738 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:09.171400 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.171868 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.172769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.173218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.323021 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:09.331865 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1a3b23c7-7a27-46a3-b2dd-f1ab6151aeb7 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.173085 Jul 26 05:06:09.332639 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 311/603] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:09 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:09.592359 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:09.592864 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:09.599429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.599904 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.600673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.601111 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.746299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:09.746816 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:09.747213 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:09.753778 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.754221 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.755017 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:09.755593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:09.756043 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:09.757277 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:09.758472 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-853fe2f0-eed1-4a6a-a67d-8f9b9ee5cc41 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.170227 Jul 26 05:06:09.759339 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 293/604] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:09 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:09.776414 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:09.829257 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:09.837866 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7a8f9eb9-9ef8-478f-aeee-cae0dd2af350 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.095424 Jul 26 05:06:09.838839 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 312/605] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:09 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:10.352993 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:10.353608 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:10.363020 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.363591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.364391 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.365006 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.510454 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:10.518407 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7f26adaf-9179-4655-98a2-d84a443e1fe3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.169392 Jul 26 05:06:10.518968 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 294/606] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:10 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:10.781191 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:10.781812 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:10.788963 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.789409 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.790190 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.790659 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.860393 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:10.861081 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:10.868005 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.868454 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.869228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:10.869653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:10.969945 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:10.973299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:10.984961 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:10.990800 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-eff0bdec-96d2-4b53-b656-7af37464dfd1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.134180 Jul 26 05:06:10.991816 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 295/607] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:10 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:10.992966 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:10.994436 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-52f58d9e-29af-473a-a495-a84efe434647 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.217196 Jul 26 05:06:10.995376 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 313/608] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:10 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:11.539986 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:11.540591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:11.547211 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:11.552014 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:11.552866 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:11.553307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:11.718303 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:11.726959 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ed6903f2-75e1-4906-895c-af7c2726dfd9 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.190887 Jul 26 05:06:11.727542 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 296/609] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:11 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:12.011736 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:12.012357 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:12.018932 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:12.019575 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:12.025258 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:12.025715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:12.026664 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:12.027119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:12.033068 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:12.033566 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:12.034360 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:12.034759 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:12.104407 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:12.113412 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-39ce269e-651a-4322-95d2-8988c0c6adff tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.105384 Jul 26 05:06:12.114397 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 314/610] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:12 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:12.208434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:12.226168 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:12.228671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:12.235597 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-88043d34-4a5c-4cf0-8b84-10badceb6f08 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.215331 Jul 26 05:06:12.240149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 297/611] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:12 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:12.754696 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:12.755905 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:12.767086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:12.768957 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:12.769827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:12.771363 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:12.772669 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:12.949698 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:12.958206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18df73d5-d4f8-42e2-82a8-8f931b6ccc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.211679 Jul 26 05:06:12.958821 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 315/612] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:12 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:13.135131 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:13.135808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:13.142489 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.142955 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:13.143802 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.147587 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:13.212579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:13.220640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8a992f2a-c7ac-4d40-a642-d29d1b905d80 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.089317 Jul 26 05:06:13.221318 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 298/613] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:13 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:13.258602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:13.259241 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:13.266006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.266448 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:13.267215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.267735 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:13.417526 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:13.425996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:13.427511 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:13.428726 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e28dffbe-1ef9-48fb-943e-1e7b87b2be1e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.174189 Jul 26 05:06:13.429295 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 316/614] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:13 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:13.980131 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:13.980749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:13.987713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.988167 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:13.988958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:13.989389 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.145660 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:14.153452 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f7f2da59-6fd5-4818-8261-6299441b4887 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.177478 Jul 26 05:06:14.154620 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 299/615] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:13 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:14.242602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:14.243257 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:14.250310 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:14.250842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.251737 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:14.252294 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.319487 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:14.327153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-99ab29d4-0831-4d2c-a741-5ab827f018c5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.088511 Jul 26 05:06:14.327770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 317/616] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:14 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:14.454935 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:14.456163 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:14.462701 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:14.463351 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.464440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:14.464874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:14.611514 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:14.620284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:14.621724 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:14.623191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-26011618-332e-4c49-8b3e-71b19a79c602 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.172626 Jul 26 05:06:14.623884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 300/617] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:14 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:15.179068 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:15.179711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:15.186064 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:15.186626 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:15.187657 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:15.188073 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:15.347855 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:15.349142 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:15.355857 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:15.356303 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:15.357073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:15.357501 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:15.402941 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:15.411287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fe0b973f-cfab-48af-9a33-8b79452d1be5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.236075 Jul 26 05:06:15.411956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 318/618] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:15 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:15.423344 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:15.431454 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f13fc2f2-081f-4742-8836-53cf7bac9835 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1218 microversion: 2.1 time: 0.087701 Jul 26 05:06:15.432058 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 301/619] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:15 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:15.646809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:15.647543 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:15.654046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:15.654495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:15.655297 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:15.655773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:15.790842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:15.802053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:15.803627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:15.804803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8d115177-d02b-452a-bdd0-f42766e93730 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.162255 Jul 26 05:06:15.805386 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 319/620] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:15 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 05:06:16.433908 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:16.434522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:16.437627 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=74 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:16.443702 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.444143 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.444908 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.445335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.450082 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=4 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:16.455236 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:16.458927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:16.462714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.463177 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.463978 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.464395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.510636 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=16 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:16.549984 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:16.557860 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f5b2eda1-0bfc-4d72-bd59-ed0c38d96f88 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1266 microversion: 2.1 time: 0.108471 Jul 26 05:06:16.558646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 320/621] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:16 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:16.617827 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:16.626243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-941dfd23-0e48-455a-a01f-03ae54b6e560 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.196540 Jul 26 05:06:16.626822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 302/622] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:16 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:16.829358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:16.830181 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:16.840243 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.840876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.842050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:16.842753 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:16.979477 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:16.987860 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:16.989375 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:16.990559 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e66d7270-5230-4c2d-a357-e991e58a1ac3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.165517 Jul 26 05:06:16.991154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 321/623] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:16 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:17.581555 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:17.582150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:17.589179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:17.589620 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:17.590370 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:17.590793 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:17.647842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:17.648439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:17.655222 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:17.656129 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:17.656445 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:17.656881 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:17.658266 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:17.660572 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:17.667389 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aeb49669-d0f6-4b9e-a218-544720f13154 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1274 microversion: 2.1 time: 0.089864 Jul 26 05:06:17.667988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 303/624] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:17 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:17.886292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:17.894030 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4b173a96-a75c-47f9-a6a3-45184997d637 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.250005 Jul 26 05:06:17.894593 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 322/625] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:17 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:18.021522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:18.022199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:18.028701 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.029214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.030102 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.030608 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.264631 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:18.272970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:18.274464 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:18.275676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-21bf0ca8-cf7a-43e4-a287-1298a572bdad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.259031 Jul 26 05:06:18.283239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 304/626] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:18 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:18.425886 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6265a9e3-5ecc-4eb7-9b5e-3b83ce6dca4b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:18.426086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6265a9e3-5ecc-4eb7-9b5e-3b83ce6dca4b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:18.432413 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6265a9e3-5ecc-4eb7-9b5e-3b83ce6dca4b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.432849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6265a9e3-5ecc-4eb7-9b5e-3b83ce6dca4b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.433604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6265a9e3-5ecc-4eb7-9b5e-3b83ce6dca4b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.434031 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6265a9e3-5ecc-4eb7-9b5e-3b83ce6dca4b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.465836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6265a9e3-5ecc-4eb7-9b5e-3b83ce6dca4b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/cb5e864e-e7d2-4c29-9bc0-1824a06bceac" status: 200 len: 194 microversion: 2.1 time: 0.045246 Jul 26 05:06:18.466770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 323/627] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Jul 26 05:06:18 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/cb5e864e-e7d2-4c29-9bc0-1824a06bceac => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:18.477711 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:18.478358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:18.484753 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.485202 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.486033 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.486468 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.580132 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lazy-loading 'services' on Instance uuid cfddd200-54c7-46ee-9bda-5868344fcb10 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:18.654483 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1075979d-62b3-4b53-8079-772ba1cc772a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/cb5e864e-e7d2-4c29-9bc0-1824a06bceac" status: 202 len: 0 microversion: 2.1 time: 0.180744 Jul 26 05:06:18.655206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 305/628] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:06:18 2022] DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments/cb5e864e-e7d2-4c29-9bc0-1824a06bceac => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:06:18.693564 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:18.694631 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:18.702389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.703002 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.704660 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.705164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.916962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:18.917751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:18.924829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.925368 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:18.926122 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:18.926547 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.013015 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:19.020900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cd5437e2-5180-438e-bfb0-60fa0e24344f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.334044 Jul 26 05:06:19.021575 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 324/629] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:18 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:19.142363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:19.160920 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-781054dc-9e45-4898-8dc8-a592f3fae607 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.248145 Jul 26 05:06:19.171577 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 306/630] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:18 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:19.298566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:19.299169 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:19.305722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:19.306180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.306955 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:19.307370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.497907 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-26d97246-a37f-4e06-92ee-fdb4b2d8f45a req-4715c575-5eec-4e7d-8a0e-02833dcffec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1de98d-16f9-4631-978c-51844cf6fcec", "tag": "e0e2d27e-2a71-4b67-b6d0-d23287acc24f"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:19.508546 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-26d97246-a37f-4e06-92ee-fdb4b2d8f45a req-4715c575-5eec-4e7d-8a0e-02833dcffec6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:19.509082 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-26d97246-a37f-4e06-92ee-fdb4b2d8f45a req-4715c575-5eec-4e7d-8a0e-02833dcffec6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.521037 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-26d97246-a37f-4e06-92ee-fdb4b2d8f45a req-4715c575-5eec-4e7d-8a0e-02833dcffec6 service nova] Creating event network-changed:e0e2d27e-2a71-4b67-b6d0-d23287acc24f for instance da1de98d-16f9-4631-978c-51844cf6fcec on hv-cinder-85057 Jul 26 05:06:19.526881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-26d97246-a37f-4e06-92ee-fdb4b2d8f45a req-4715c575-5eec-4e7d-8a0e-02833dcffec6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032564 Jul 26 05:06:19.527814 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 307/631] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:06:19.532463 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:19.541300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:19.542801 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:19.544006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3dd17ff5-ade5-4d8f-9f4f-8ef7b5042945 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.249619 Jul 26 05:06:19.544579 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 325/632] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:19 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:19.872781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e4ecbd8f-a46a-46f8-ab26-ff9be0487ae5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:19.875072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e4ecbd8f-a46a-46f8-ab26-ff9be0487ae5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:19.881387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4ecbd8f-a46a-46f8-ab26-ff9be0487ae5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:19.881818 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4ecbd8f-a46a-46f8-ab26-ff9be0487ae5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.882578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4ecbd8f-a46a-46f8-ab26-ff9be0487ae5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:19.882991 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4ecbd8f-a46a-46f8-ab26-ff9be0487ae5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:19.912006 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e4ecbd8f-a46a-46f8-ab26-ff9be0487ae5 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044046 Jul 26 05:06:19.912579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 308/633] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:06:19 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:06:20.033136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0b0acfa9-e754-45bb-a91c-59cc7150519b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:20.035504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0b0acfa9-e754-45bb-a91c-59cc7150519b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:20.042359 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0acfa9-e754-45bb-a91c-59cc7150519b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.043226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0acfa9-e754-45bb-a91c-59cc7150519b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.043360 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:20.043590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0acfa9-e754-45bb-a91c-59cc7150519b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.044054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0b0acfa9-e754-45bb-a91c-59cc7150519b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.044544 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:20.051633 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.052582 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.053617 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.054270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.076141 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0b0acfa9-e754-45bb-a91c-59cc7150519b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046904 Jul 26 05:06:20.077163 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 326/634] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:06:20 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:06:20.140756 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:20.141256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:20.147599 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.148054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.148830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.149330 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.181729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:20.246699 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:20.288801 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0bba0a02-b903-4163-8505-6bccfb3b7d97 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 204 len: 0 microversion: 2.1 time: 0.151443 Jul 26 05:06:20.289479 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 327/635] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:20 2022] DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 05:06:20.295428 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:20.296186 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:20.304930 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.305767 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.306879 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.307444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.589348 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:20.597440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0113f893-1e67-4d0f-a4c8-1525224c99c0 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.558775 Jul 26 05:06:20.598351 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 309/636] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:20 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:20.605266 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:20.606426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:20.613237 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.613930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.614868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.615440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.652323 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:20.660272 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-60434840-c6ad-442b-9234-3e6553dc1440 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.369539 Jul 26 05:06:20.660852 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 328/637] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:20 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:20.665468 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-719ae152-64b7-47e4-baf9-95645fa48e2a req-9983f218-82b2-4b33-92ac-4b4c92198ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e577df-08fa-4428-a9a2-44458ca27e2a", "name": "network-vif-plugged", "status": "completed", "tag": "19c54117-94e3-4ff4-a8ce-06b6514cd2e6"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:20.674740 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-719ae152-64b7-47e4-baf9-95645fa48e2a req-9983f218-82b2-4b33-92ac-4b4c92198ed9 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.675282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-719ae152-64b7-47e4-baf9-95645fa48e2a req-9983f218-82b2-4b33-92ac-4b4c92198ed9 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.687040 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-719ae152-64b7-47e4-baf9-95645fa48e2a req-9983f218-82b2-4b33-92ac-4b4c92198ed9 service nova] Creating event network-vif-plugged:19c54117-94e3-4ff4-a8ce-06b6514cd2e6 for instance e2e577df-08fa-4428-a9a2-44458ca27e2a on hv-cinder-85057 Jul 26 05:06:20.692472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-719ae152-64b7-47e4-baf9-95645fa48e2a req-9983f218-82b2-4b33-92ac-4b4c92198ed9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030497 Jul 26 05:06:20.693066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 329/638] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:20.698199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:20.698878 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:20.705240 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.705677 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.706544 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:20.707053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:20.760703 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:20.768444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-05f7e3be-0f64-4282-b4e3-950c9fdd2125 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1670 microversion: 2.1 time: 0.168875 Jul 26 05:06:20.769147 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 310/639] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:20 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:20.844758 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:20.853441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:20.854939 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:20.856151 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-20cca050-f063-4cbb-beb2-bde092c4605d tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.161910 Jul 26 05:06:20.856718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 330/640] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:20 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:21.622268 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:21.623041 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:21.631760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.632211 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.632965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.633390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.681273 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:21.681925 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:21.689219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.689669 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.690436 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.690874 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.856884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:21.864819 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-76168dd3-b37c-4e0c-9ad2-d0c32f900aed tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.248437 Jul 26 05:06:21.865410 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 311/641] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:21 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:21.870549 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:21.871187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:21.877274 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.877910 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.878882 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.879322 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.947727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:21.955940 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a9022753-9b26-4cb4-99b2-da30060f2ed5 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.278518 Jul 26 05:06:21.965325 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 331/642] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:21 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:21.965325 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:21.965325 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:21.973735 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.975226 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:21.976455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:21.978091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:22.065037 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:22.072899 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-86b1b7b5-a867-43bb-be80-1a939342b84b tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1670 microversion: 2.1 time: 0.206488 Jul 26 05:06:22.073485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 312/643] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:21 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1670 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:22.133284 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:22.145713 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:22.147218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:22.148422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9b327fd7-02c0-4ed7-8c00-13b35a92596a tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.190954 Jul 26 05:06:22.148987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 332/644] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:21 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:22.707933 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-3b7ae04c-b4ca-4042-acef-f9005902a3e7 req-fde500ad-1103-4021-8782-c11c8124a3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048e3ed2-61f1-4d21-92c7-cfd8a94abb52", "name": "network-vif-plugged", "status": "completed", "tag": "74e6a160-dc8d-420e-9018-7b77f693900b"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:22.718235 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-3b7ae04c-b4ca-4042-acef-f9005902a3e7 req-fde500ad-1103-4021-8782-c11c8124a3d6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:22.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-3b7ae04c-b4ca-4042-acef-f9005902a3e7 req-fde500ad-1103-4021-8782-c11c8124a3d6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:22.730132 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-3b7ae04c-b4ca-4042-acef-f9005902a3e7 req-fde500ad-1103-4021-8782-c11c8124a3d6 service nova] Creating event network-vif-plugged:74e6a160-dc8d-420e-9018-7b77f693900b for instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 on hv-cinder-85057 Jul 26 05:06:22.735179 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-3b7ae04c-b4ca-4042-acef-f9005902a3e7 req-fde500ad-1103-4021-8782-c11c8124a3d6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 Jul 26 05:06:22.735872 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 313/645] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:22.886388 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:22.887094 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:22.893923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:22.894363 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:22.895131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:22.895736 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:22.978276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:22.978891 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:22.986786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:22.989969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:22.992951 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:22.995546 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:23.246452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:23.254597 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d43d4c14-b28b-42e1-adf2-8d91f71bb46f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.372235 Jul 26 05:06:23.255324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 333/646] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:22 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:23.272758 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:23.273357 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:23.279565 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:23.280012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:23.281121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:23.281121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:23.309967 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:23.318357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2c3827e6-460b-440f-b81d-c0afcc7fe169 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.344760 Jul 26 05:06:23.319028 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 314/647] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:22 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:23.323948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:23.324615 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:23.333625 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:23.334073 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:23.334839 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:23.335263 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:23.638362 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:23.646655 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d80f0a3f-8e6a-43ee-bf2b-c5ae7319948f tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1670 microversion: 2.1 time: 0.377692 Jul 26 05:06:23.647246 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 334/648] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:23 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1670 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:23.673927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:23.682943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:23.684431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:23.685581 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a405d905-b540-4f46-a71f-5806b547ff60 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.365557 Jul 26 05:06:23.686146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 315/649] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:23 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:24.150215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-9a2badef-34ad-4480-bbfc-716f2e0c0951 req-ef5d7f12-3b94-48d5-be0a-216502a1872f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfddd200-54c7-46ee-9bda-5868344fcb10", "name": "network-vif-deleted", "tag": "714b804c-f359-4995-a514-95d668e03a97"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:24.161192 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9a2badef-34ad-4480-bbfc-716f2e0c0951 req-ef5d7f12-3b94-48d5-be0a-216502a1872f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.161882 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-9a2badef-34ad-4480-bbfc-716f2e0c0951 req-ef5d7f12-3b94-48d5-be0a-216502a1872f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.174282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-9a2badef-34ad-4480-bbfc-716f2e0c0951 req-ef5d7f12-3b94-48d5-be0a-216502a1872f service nova] Creating event network-vif-deleted:714b804c-f359-4995-a514-95d668e03a97 for instance cfddd200-54c7-46ee-9bda-5868344fcb10 on hv-cinder-85057 Jul 26 05:06:24.179322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-9a2badef-34ad-4480-bbfc-716f2e0c0951 req-ef5d7f12-3b94-48d5-be0a-216502a1872f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032827 Jul 26 05:06:24.180025 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 335/650] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:24.275924 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:24.276698 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:24.283178 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.283657 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.284431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.284862 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.340360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:24.340974 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:24.350935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.351607 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.352748 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.353170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.471917 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:24.480624 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5f689c34-3c12-47af-a0d4-56ed3cddc65f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.208549 Jul 26 05:06:24.481619 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 316/651] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:24 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:24.522647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:24.530394 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-89ac616b-44e7-45ca-b12b-1f914f4067ac tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1266 microversion: 2.1 time: 0.194537 Jul 26 05:06:24.530995 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 336/652] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:24 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:24.671650 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:24.672680 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:24.682747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.683473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.684799 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.685508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.709848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:24.710640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:24.717761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.718211 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.719184 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:24.719703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:24.758845 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:24.771806 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b324191b-98fa-4cb2-a912-9d1c4faedfb9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1602 microversion: 2.1 time: 0.106488 Jul 26 05:06:24.772659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 317/653] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:24 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1602 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:24.861999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:24.871531 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:24.873157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:24.874356 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3ba1abf5-39ec-4de8-b296-e265ae14b551 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1730 microversion: 2.20 time: 0.168581 Jul 26 05:06:24.874954 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 337/654] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:24 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:25.505181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:25.505784 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:25.512594 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.513038 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.513808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.514267 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.551236 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:25.551991 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:25.563098 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.564062 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.565080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.565714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.702267 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:25.710063 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-91b8b4dc-7bd3-4651-98ab-74c1ebb2a023 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.210870 Jul 26 05:06:25.710647 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 318/655] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:25 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:25.740370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:25.748184 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a6a1f085-4299-4329-ab1d-81f342112f25 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1452 microversion: 2.1 time: 0.200866 Jul 26 05:06:25.748745 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 338/656] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:25 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1452 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:25.768625 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:25.769271 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:25.775860 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.776315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.777075 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.777510 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.792217 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:25.792829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:25.799158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.799590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.800386 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.800795 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.835223 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.835682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.836109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lazy-loading 'fault' on Instance uuid cfddd200-54c7-46ee-9bda-5868344fcb10 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:25.898453 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39de5897bd2d4e2b91c05d8dda5827be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9747c4b81e8844e989d70b8001a196b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:25.907958 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4061b448-41ff-466d-83ac-95552ff394d9 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 200 len: 1324 microversion: 2.1 time: 0.118739 Jul 26 05:06:25.908926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 339/657] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:25 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 1324 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:25.914499 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:25.915110 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:25.922311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.922759 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.923528 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:25.924218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:25.946288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:25.960989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1c384dec-bebe-4630-a505-3dc5c853d122 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1452 microversion: 2.1 time: 0.196128 Jul 26 05:06:25.961724 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 319/658] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:25 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1452 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:26.104670 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:26.113029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:26.114850 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:26.116117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9fd09896-1749-4a29-90be-e7910c08ac0f tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1717 microversion: 2.20 time: 0.205965 Jul 26 05:06:26.116678 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 340/659] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:25 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1717 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:06:26.731397 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:26.732009 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:26.738855 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:26.739393 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:26.740579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:26.740989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:26.876442 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:26.884479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-99d42239-31d9-4909-aeca-cba9b0d92b92 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.157092 Jul 26 05:06:26.885437 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 320/660] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:26 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:26.930511 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:26.931130 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:26.938405 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:26.938881 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:26.939873 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:26.940299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:26.954460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] HTTP exception thrown: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Request method failure captured: Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 HTTP/1.1 Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33Tcj8aEgFWVoSxDwDNp8IVfCM4YUynvgpRtmxzPdQr8X-kb5Gem6m8Mzf7p74qM-XTeu40RHRW7y5RnFmhsqWuIYfyz4rtAInBN0Pkuhbj4vMdcHAVwChZMwNYNJl5ZsBFmJfIbS37QGwLQPE4QMIrCZ8BnsMOR2aRjyN5PkzBeJRo Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:06:26.956422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}] Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 39de5897bd2d4e2b91c05d8dda5827be Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:26.958122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'cfddd200-54c7-46ee-9bda-5868344fcb10'} Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:26.959136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:26.961671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:26.964985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Returning 404 to user: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:26.966533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-69d77149-ea1c-4cfb-b507-f49ae9bebe83 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 404 len: 111 microversion: 2.1 time: 0.039526 Jul 26 05:06:26.967882 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 341/661] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:26 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:26.977315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-212823f5-780c-4cef-b5ff-e243ad258213 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '.version_select at 0x7f0e95075d30>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:26.997516 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-212823f5-780c-4cef-b5ff-e243ad258213 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529453" status: 202 len: 0 microversion: 2.1 time: 0.025001 Jul 26 05:06:26.998135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 321/662] 10.222.0.17 () {58 vars in 1209 bytes} [Tue Jul 26 05:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529453 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:06:27.906868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:27.908465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:27.916935 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:27.917570 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:27.918647 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:27.919409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:27.924732 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:27.934254 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-7b0cd0a1-da71-405b-944b-e19eb7e49734 req-05632a03-be0c-4ab3-be64-a18e3deb4fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048e3ed2-61f1-4d21-92c7-cfd8a94abb52", "tag": "74e6a160-dc8d-420e-9018-7b77f693900b"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:27.953261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-7b0cd0a1-da71-405b-944b-e19eb7e49734 req-05632a03-be0c-4ab3-be64-a18e3deb4fcb service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:27.953727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-7b0cd0a1-da71-405b-944b-e19eb7e49734 req-05632a03-be0c-4ab3-be64-a18e3deb4fcb service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:27.966324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-7b0cd0a1-da71-405b-944b-e19eb7e49734 req-05632a03-be0c-4ab3-be64-a18e3deb4fcb service nova] Creating event network-changed:74e6a160-dc8d-420e-9018-7b77f693900b for instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 on hv-cinder-85057 Jul 26 05:06:27.971878 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-7b0cd0a1-da71-405b-944b-e19eb7e49734 req-05632a03-be0c-4ab3-be64-a18e3deb4fcb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108515 Jul 26 05:06:27.972904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 342/663] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:28.179146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:28.187243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3024214c-bd06-42b7-b9eb-7d75224f22b2 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.285430 Jul 26 05:06:28.188181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 322/664] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:27 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:28.591847 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-8de6fb4b-639e-44cd-853a-95bebfc59e5f req-3148b7a9-4aa4-4d65-9bd3-84a173585d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1de98d-16f9-4631-978c-51844cf6fcec", "name": "network-vif-plugged", "status": "completed", "tag": "e0e2d27e-2a71-4b67-b6d0-d23287acc24f"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:28.601568 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8de6fb4b-639e-44cd-853a-95bebfc59e5f req-3148b7a9-4aa4-4d65-9bd3-84a173585d87 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:28.601993 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8de6fb4b-639e-44cd-853a-95bebfc59e5f req-3148b7a9-4aa4-4d65-9bd3-84a173585d87 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:28.613442 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-8de6fb4b-639e-44cd-853a-95bebfc59e5f req-3148b7a9-4aa4-4d65-9bd3-84a173585d87 service nova] Creating event network-vif-plugged:e0e2d27e-2a71-4b67-b6d0-d23287acc24f for instance da1de98d-16f9-4631-978c-51844cf6fcec on hv-cinder-85057 Jul 26 05:06:28.618460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-8de6fb4b-639e-44cd-853a-95bebfc59e5f req-3148b7a9-4aa4-4d65-9bd3-84a173585d87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030814 Jul 26 05:06:28.619127 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 343/665] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:29.208748 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:29.209361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:29.216710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.217158 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.217903 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.218360 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.356697 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:29.364548 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-25e2f8aa-ff4b-4923-87cb-533be5c49fd3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.159792 Jul 26 05:06:29.365150 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 323/666] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:29 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:29.934807 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:29.935419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:29.942525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.942972 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.943868 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.944300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.958301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] HTTP exception thrown: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Request method failure captured: Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 HTTP/1.1 Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33Tcj8aEgFWVoSxDwDNp8IVfCM4YUynvgpRtmxzPdQr8X-kb5Gem6m8Mzf7p74qM-XTeu40RHRW7y5RnFmhsqWuIYfyz4rtAInBN0Pkuhbj4vMdcHAVwChZMwNYNJl5ZsBFmJfIbS37QGwLQPE4QMIrCZ8BnsMOR2aRjyN5PkzBeJRo Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:06:29.960006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}] Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 39de5897bd2d4e2b91c05d8dda5827be Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:29.961640 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'cfddd200-54c7-46ee-9bda-5868344fcb10'} Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:29.962598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:29.964108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:29.965656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Returning 404 to user: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:29.965656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d4a9c091-a03d-4306-825f-d452c8f40c19 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 404 len: 111 microversion: 2.1 time: 0.031306 Jul 26 05:06:29.965656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 344/667] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:29 2022] DELETE /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:29.971784 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:29.972381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: cfddd200-54c7-46ee-9bda-5868344fcb10] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:29.979637 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.980083 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.980844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:29.981268 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:29.994409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] HTTP exception thrown: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Request method failure captured: Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 HTTP/1.1 Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33Tcj8aEgFWVoSxDwDNp8IVfCM4YUynvgpRtmxzPdQr8X-kb5Gem6m8Mzf7p74qM-XTeu40RHRW7y5RnFmhsqWuIYfyz4rtAInBN0Pkuhbj4vMdcHAVwChZMwNYNJl5ZsBFmJfIbS37QGwLQPE4QMIrCZ8BnsMOR2aRjyN5PkzBeJRo Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:06:29.996045 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}] Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 39de5897bd2d4e2b91c05d8dda5827be Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:29.997563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'cfddd200-54c7-46ee-9bda-5868344fcb10'} Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:30.001363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. Jul 26 05:06:30.002786 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:30.004508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Returning 404 to user: Instance cfddd200-54c7-46ee-9bda-5868344fcb10 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:30.004508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-18c7a78b-8c8f-48ae-954d-c5af9b847623 tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10" status: 404 len: 111 microversion: 2.1 time: 0.031364 Jul 26 05:06:30.004508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 324/668] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:29 2022] GET /compute/v2.1/servers/cfddd200-54c7-46ee-9bda-5868344fcb10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:30.386262 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:30.386884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:30.393697 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:30.394164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:30.394924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:30.395344 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:30.533381 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:30.541621 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0dadb0fa-522d-4522-b16e-d5e5012e01b5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1314 microversion: 2.1 time: 0.159521 Jul 26 05:06:30.542154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 345/669] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:30 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:31.149264 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:31.149808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:31.157337 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.157874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.158653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.159057 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.174235 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] HTTP exception thrown: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Request method failure captured: Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 HTTP/1.1 Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33Tcj8aEgFWVoSxDwDNp8IVfCM4YUynvgpRtmxzPdQr8X-kb5Gem6m8Mzf7p74qM-XTeu40RHRW7y5RnFmhsqWuIYfyz4rtAInBN0Pkuhbj4vMdcHAVwChZMwNYNJl5ZsBFmJfIbS37QGwLQPE4QMIrCZ8BnsMOR2aRjyN5PkzBeJRo Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:06:31.175817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}] Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 39de5897bd2d4e2b91c05d8dda5827be Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.177340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3'} Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:31.178221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.179735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.181250 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Returning 404 to user: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:31.181250 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e64c66d3-fa8d-4361-88ce-94e8ba03e96d tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 404 len: 111 microversion: 2.1 time: 0.031825 Jul 26 05:06:31.181250 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 325/670] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:31 2022] DELETE /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:31.188551 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:31.189253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] [instance: 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:31.197517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.197951 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.198713 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.199140 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.212946 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] HTTP exception thrown: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Request method failure captured: Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 HTTP/1.1 Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33Tcj8aEgFWVoSxDwDNp8IVfCM4YUynvgpRtmxzPdQr8X-kb5Gem6m8Mzf7p74qM-XTeu40RHRW7y5RnFmhsqWuIYfyz4rtAInBN0Pkuhbj4vMdcHAVwChZMwNYNJl5ZsBFmJfIbS37QGwLQPE4QMIrCZ8BnsMOR2aRjyN5PkzBeJRo Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:06:31.214465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9747c4b81e8844e989d70b8001a196b0"}]}] Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 9747c4b81e8844e989d70b8001a196b0 Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1863873070 Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 39de5897bd2d4e2b91c05d8dda5827be Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeTestJSON-1863873070-project Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.216086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3'} Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:31.216899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. Jul 26 05:06:31.218343 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:06:31.219618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] Returning 404 to user: Instance 0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:31.219618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-85eabd68-0da0-4e57-a79a-e9b07b6b218a tempest-AttachVolumeTestJSON-1863873070 tempest-AttachVolumeTestJSON-1863873070-project] 10.222.0.17 "GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3" status: 404 len: 111 microversion: 2.1 time: 0.033566 Jul 26 05:06:31.219618 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 346/671] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:31 2022] GET /compute/v2.1/servers/0323c7da-4a7e-4c3f-a99f-89ec9c08cfd3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:31.563598 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:31.564246 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:31.570761 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.571201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.572021 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:31.572457 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:31.821592 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:31.829768 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fd73216b-386a-483c-b854-c9fca1474740 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1498 microversion: 2.1 time: 0.271062 Jul 26 05:06:31.830352 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 326/672] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:31 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1498 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:32.343029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:32.343620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:32.350126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.350564 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.351336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.351796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.380708 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:32.407522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:32.460750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-18ce5433-776f-4460-ba7b-dd562410f45d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "DELETE /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 204 len: 0 microversion: 2.1 time: 0.121842 Jul 26 05:06:32.461997 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 347/673] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:32 2022] DELETE /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:32.471402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:32.472138 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:32.478690 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.479212 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.480110 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:32.480605 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:32.742068 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:32.750721 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0e1eff18-488b-45cc-81d1-4de2953c536f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1504 microversion: 2.1 time: 0.283630 Jul 26 05:06:32.751310 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 327/674] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:32 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:33.773218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:33.773912 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:33.781145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.781546 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.784358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:33.784358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:33.980727 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:33.988772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f55d1725-1651-4633-a2c6-e32256eba4f3 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1504 microversion: 2.1 time: 0.219959 Jul 26 05:06:33.989633 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 348/675] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:33 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:34.540486 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-bd266d38-95d2-439d-828c-eca0331717a4 req-a575c391-1622-43fc-8649-2d5fa6d0e8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1de98d-16f9-4631-978c-51844cf6fcec", "name": "network-vif-deleted", "tag": "e0e2d27e-2a71-4b67-b6d0-d23287acc24f"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:34.559546 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-bd266d38-95d2-439d-828c-eca0331717a4 req-a575c391-1622-43fc-8649-2d5fa6d0e8b3 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:34.560555 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-bd266d38-95d2-439d-828c-eca0331717a4 req-a575c391-1622-43fc-8649-2d5fa6d0e8b3 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:34.578636 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-bd266d38-95d2-439d-828c-eca0331717a4 req-a575c391-1622-43fc-8649-2d5fa6d0e8b3 service nova] Creating event network-vif-deleted:e0e2d27e-2a71-4b67-b6d0-d23287acc24f for instance da1de98d-16f9-4631-978c-51844cf6fcec on hv-cinder-85057 Jul 26 05:06:34.587820 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-bd266d38-95d2-439d-828c-eca0331717a4 req-a575c391-1622-43fc-8649-2d5fa6d0e8b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053092 Jul 26 05:06:34.600476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 328/676] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:35.010580 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:35.011190 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:35.018263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:35.018688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:35.019468 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:35.019974 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:35.052096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:35.052516 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:35.053004 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lazy-loading 'fault' on Instance uuid da1de98d-16f9-4631-978c-51844cf6fcec {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:35.097613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:35.106160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-df3d01d5-ece8-4a7e-a1d2-a2ffb11f86df tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 200 len: 1304 microversion: 2.1 time: 0.099559 Jul 26 05:06:35.106889 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 349/677] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:35 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:36.131585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:36.131585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: da1de98d-16f9-4631-978c-51844cf6fcec] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:36.136975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.137419 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.138242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.138623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.152260 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] HTTP exception thrown: Instance da1de98d-16f9-4631-978c-51844cf6fcec could not be found. Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Request method failure captured: Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec HTTP/1.1 Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33Y7EZuDXhvxsJ3DJ50XWk7BzTUuOZa3dmtA8eN9uKwySWAdYkBsrRR5D8g8YaKaj0UNW3U6jD1ABhfKU0JinQQMNZRzfi0U0YiSsszOt3Bn-3NEioPpBP49U8wm3aCQsn_yrXNufdFby-MLN8y1vyf1pOwMgMR8K_LkDhwZLcNAkX0 Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: a30ecee1cac84583bb0e1c74eb333314 Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesActionsTest-479219644 Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:06:36.153940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a30ecee1cac84583bb0e1c74eb333314"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a30ecee1cac84583bb0e1c74eb333314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30ecee1cac84583bb0e1c74eb333314"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30ecee1cac84583bb0e1c74eb333314"}]}] Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesActionsTest-479219644 Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: a30ecee1cac84583bb0e1c74eb333314 Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesActionsTest-479219644 Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesActionsTest-479219644-project Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: ae6d25b14db34c6392999d0f7a929772 Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesActionsTest-479219644-project Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance da1de98d-16f9-4631-978c-51844cf6fcec could not be found. Jul 26 05:06:36.155538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'da1de98d-16f9-4631-978c-51844cf6fcec'} Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1de98d-16f9-4631-978c-51844cf6fcec could not be found. Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:36.156492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1de98d-16f9-4631-978c-51844cf6fcec could not be found. Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1de98d-16f9-4631-978c-51844cf6fcec could not be found. Jul 26 05:06:36.157876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:36.159064 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Returning 404 to user: Instance da1de98d-16f9-4631-978c-51844cf6fcec could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:36.159064 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f0f156da-0c7d-47ca-82d8-34fb30a5050b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec" status: 404 len: 111 microversion: 2.1 time: 0.030656 Jul 26 05:06:36.160082 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 329/678] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:36 2022] GET /compute/v2.1/servers/da1de98d-16f9-4631-978c-51844cf6fcec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:36.258836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1946756300", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "networks": [{"uuid": "4b557bf1-ddc6-4648-bd73-0fa056e3765b"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:36.316035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] validate_networks() for [('4b557bf1-ddc6-4648-bd73-0fa056e3765b', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:06:36.677306 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:06:36.677729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:06:36.678204 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:06:36.678601 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:06:36.679101 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:06:36.689079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.689550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.690315 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:36.690791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:36.707739 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Getting quotas for project a30ecee1cac84583bb0e1c74eb333314. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:06:36.711938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Getting quotas for user ae6d25b14db34c6392999d0f7a929772 and project a30ecee1cac84583bb0e1c74eb333314. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:06:36.722891 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:06:36.725202 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:06:36.747389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:36.777156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6daf2df5-f986-4a77-b4b8-27143add41f1 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522005 Jul 26 05:06:36.781900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 350/679] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:06:36.789631 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c13c6c9c-a21f-4f24-8ac4-50e9a86baa96 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:36.790494 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c13c6c9c-a21f-4f24-8ac4-50e9a86baa96 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:36.854653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c13c6c9c-a21f-4f24-8ac4-50e9a86baa96 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:36.862380 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c13c6c9c-a21f-4f24-8ac4-50e9a86baa96 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1214 microversion: 2.1 time: 0.077288 Jul 26 05:06:36.864396 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 330/680] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:36 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:37.885018 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:37.885662 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:37.894224 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:37.894871 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:37.895685 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:37.896126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:37.987925 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:37.997740 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2c62610a-9d73-4c53-a03a-5c99be16352b tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1274 microversion: 2.1 time: 0.117376 Jul 26 05:06:37.998410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 351/681] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:37 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:39.020211 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:39.020793 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:39.028867 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.029315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.030111 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.030543 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.298412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:39.311715 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e3c66155-e730-4a30-ac7c-face05092be8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.295147 Jul 26 05:06:39.312605 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 331/682] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:39 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:39.699978 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-25a81159-41f0-4009-9ac3-b4f97a58d9b9 req-c224e6bb-8c4f-4052-b370-e42fffb4b2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ef8ebe-6090-4378-a088-253fced14340", "tag": "b7aa0b96-1fa6-4745-b8d2-ed2bdc0ca035"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:39.711423 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-25a81159-41f0-4009-9ac3-b4f97a58d9b9 req-c224e6bb-8c4f-4052-b370-e42fffb4b2c3 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:39.712052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-25a81159-41f0-4009-9ac3-b4f97a58d9b9 req-c224e6bb-8c4f-4052-b370-e42fffb4b2c3 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:39.724661 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-25a81159-41f0-4009-9ac3-b4f97a58d9b9 req-c224e6bb-8c4f-4052-b370-e42fffb4b2c3 service nova] Creating event network-changed:b7aa0b96-1fa6-4745-b8d2-ed2bdc0ca035 for instance 19ef8ebe-6090-4378-a088-253fced14340 on hv-cinder-85057 Jul 26 05:06:39.729491 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-25a81159-41f0-4009-9ac3-b4f97a58d9b9 req-c224e6bb-8c4f-4052-b370-e42fffb4b2c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033712 Jul 26 05:06:39.730097 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 352/683] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:40.341487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:40.342102 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:40.352043 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:40.352491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:40.353261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:40.353691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:40.490821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:40.498889 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5f39d1a0-8d67-49ea-af3f-48a96e8b3b21 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.163262 Jul 26 05:06:40.499466 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 332/684] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:40 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:41.528237 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:41.528940 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:41.535278 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.535770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.536533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:41.536968 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:41.696718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:41.705017 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2dd195cf-d560-4183-a40b-bfcb555fa9dc tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.181678 Jul 26 05:06:41.705591 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 353/685] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:41 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:42.726737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:42.727280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:42.734484 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:42.734949 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:42.735785 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:42.736218 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:42.885028 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:42.893105 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3212004b-267e-4137-8f63-91463b3f8a27 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.170474 Jul 26 05:06:42.893690 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 333/686] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:42 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:43.917422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:43.918032 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:43.925280 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:43.925725 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:43.926490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:43.926920 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:44.063853 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:44.071756 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d5c3a33d-5cdd-4e32-8e9f-34154a447523 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.158386 Jul 26 05:06:44.072320 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 354/687] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:43 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:45.092777 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:45.094156 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:45.101253 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:45.102194 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:45.103257 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:45.103705 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:45.253728 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:45.261431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d9589201-4e12-4a63-9371-5f559bbaabf5 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.172559 Jul 26 05:06:45.261999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 334/688] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:45 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:46.282667 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:46.283353 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:46.290108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:46.290660 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:46.294408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:46.294408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:46.431007 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:46.440180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b459df84-6dc5-4c3c-8f56-1e59c7ed543f tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.161345 Jul 26 05:06:46.440769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 355/689] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:46 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:46.523574 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-b6c279ce-075e-4ad3-9791-3c1e7f6fe55b req-137b6077-ed56-4e86-963b-d81f5e737551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ef8ebe-6090-4378-a088-253fced14340", "name": "network-vif-plugged", "status": "completed", "tag": "b7aa0b96-1fa6-4745-b8d2-ed2bdc0ca035"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:46.529618 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:46.536205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-b6c279ce-075e-4ad3-9791-3c1e7f6fe55b req-137b6077-ed56-4e86-963b-d81f5e737551 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:46.536796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-b6c279ce-075e-4ad3-9791-3c1e7f6fe55b req-137b6077-ed56-4e86-963b-d81f5e737551 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:46.550463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-b6c279ce-075e-4ad3-9791-3c1e7f6fe55b req-137b6077-ed56-4e86-963b-d81f5e737551 service nova] Creating event network-vif-plugged:b7aa0b96-1fa6-4745-b8d2-ed2bdc0ca035 for instance 19ef8ebe-6090-4378-a088-253fced14340 on hv-cinder-85057 Jul 26 05:06:46.556285 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-b6c279ce-075e-4ad3-9791-3c1e7f6fe55b req-137b6077-ed56-4e86-963b-d81f5e737551 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036311 Jul 26 05:06:46.557160 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 335/690] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:47.461793 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:47.462379 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:47.464526 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:47.465231 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:47.471643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:47.472083 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:47.472851 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:47.473287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:47.614443 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:47.622724 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3e0764a9-28eb-4ebd-9419-32eac0c2719d tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1314 microversion: 2.1 time: 0.164853 Jul 26 05:06:47.623312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 356/691] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:47 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:48.642959 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:48.649279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:48.650351 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:48.657358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:48.657804 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.658560 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:48.659013 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:48.790766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:48.799000 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-22b54298-d3ce-48a6-a3dd-19f305b3f9f9 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1498 microversion: 2.1 time: 0.157658 Jul 26 05:06:48.799572 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 336/692] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:48 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:49.419602 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:49.420144 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:49.430191 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.430750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.432038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.432466 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.459934 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:49.537787 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6b9ea05f-5856-4bb6-ac5b-63362a930b5c tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 204 len: 0 microversion: 2.1 time: 0.123897 Jul 26 05:06:49.538352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 357/693] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:06:49 2022] DELETE /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:06:49.547479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:49.548165 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:49.554600 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.555052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.555861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:49.556402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:49.710216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:49.718930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-260ce587-a5bd-40d2-bba6-4d703e38b7d8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1504 microversion: 2.1 time: 0.175865 Jul 26 05:06:49.719508 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 337/694] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:49 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:06:50.743715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:50.744317 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:50.751235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:50.751710 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:50.752474 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:50.752904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:50.899546 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:50.908300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-74685c04-6dbf-4d0f-b8fa-864b0fcd6af6 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1504 microversion: 2.1 time: 0.169097 Jul 26 05:06:50.908913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 358/695] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:50 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:51.741430 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-2893a9a5-9de9-468a-88a1-a320a2111700 req-c4e2f4d0-d307-4905-af56-b7ab51c21c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ef8ebe-6090-4378-a088-253fced14340", "name": "network-vif-deleted", "tag": "b7aa0b96-1fa6-4745-b8d2-ed2bdc0ca035"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:06:51.753685 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2893a9a5-9de9-468a-88a1-a320a2111700 req-c4e2f4d0-d307-4905-af56-b7ab51c21c48 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:51.754188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2893a9a5-9de9-468a-88a1-a320a2111700 req-c4e2f4d0-d307-4905-af56-b7ab51c21c48 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:51.767770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-2893a9a5-9de9-468a-88a1-a320a2111700 req-c4e2f4d0-d307-4905-af56-b7ab51c21c48 service nova] Creating event network-vif-deleted:b7aa0b96-1fa6-4745-b8d2-ed2bdc0ca035 for instance 19ef8ebe-6090-4378-a088-253fced14340 on hv-cinder-85057 Jul 26 05:06:51.775880 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-2893a9a5-9de9-468a-88a1-a320a2111700 req-c4e2f4d0-d307-4905-af56-b7ab51c21c48 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037893 Jul 26 05:06:51.777090 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 338/696] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:06:51.930178 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:51.930793 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:51.938447 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:51.938931 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:51.939884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:51.940281 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:51.972933 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:51.973377 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:51.973869 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lazy-loading 'fault' on Instance uuid 19ef8ebe-6090-4378-a088-253fced14340 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:06:52.016624 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d25b14db34c6392999d0f7a929772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a30ecee1cac84583bb0e1c74eb333314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:52.024140 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-772d6c5b-c9e2-4ff2-ac1d-94cde0def397 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 200 len: 1304 microversion: 2.1 time: 0.098269 Jul 26 05:06:52.024703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 359/697] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:51 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:53.046402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:53.047142 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] [instance: 19ef8ebe-6090-4378-a088-253fced14340] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:53.055031 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:53.055675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:53.056507 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:53.056886 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:53.071265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] HTTP exception thrown: Instance 19ef8ebe-6090-4378-a088-253fced14340 could not be found. Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Request method failure captured: Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 HTTP/1.1 Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33Y7EZuDXhvxsJ3DJ50XWk7BzTUuOZa3dmtA8eN9uKwySWAdYkBsrRR5D8g8YaKaj0UNW3U6jD1ABhfKU0JinQQMNZRzfi0U0YiSsszOt3Bn-3NEioPpBP49U8wm3aCQsn_yrXNufdFby-MLN8y1vyf1pOwMgMR8K_LkDhwZLcNAkX0 Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: a30ecee1cac84583bb0e1c74eb333314 Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesActionsTest-479219644 Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:06:53.072990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a30ecee1cac84583bb0e1c74eb333314"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a30ecee1cac84583bb0e1c74eb333314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30ecee1cac84583bb0e1c74eb333314"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a30ecee1cac84583bb0e1c74eb333314"}]}] Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesActionsTest-479219644 Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: a30ecee1cac84583bb0e1c74eb333314 Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesActionsTest-479219644 Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesActionsTest-479219644-project Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: ae6d25b14db34c6392999d0f7a929772 Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesActionsTest-479219644-project Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 19ef8ebe-6090-4378-a088-253fced14340 could not be found. Jul 26 05:06:53.074654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '19ef8ebe-6090-4378-a088-253fced14340'} Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ef8ebe-6090-4378-a088-253fced14340 could not be found. Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:06:53.075523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ef8ebe-6090-4378-a088-253fced14340 could not be found. Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ef8ebe-6090-4378-a088-253fced14340 could not be found. Jul 26 05:06:53.077052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:06:53.078402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] Returning 404 to user: Instance 19ef8ebe-6090-4378-a088-253fced14340 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:06:53.078402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-541789eb-84d5-4ca7-8d61-ce83edc186f8 tempest-VolumesActionsTest-479219644 tempest-VolumesActionsTest-479219644-project] 10.222.0.17 "GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340" status: 404 len: 111 microversion: 2.1 time: 0.032581 Jul 26 05:06:53.078402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 339/698] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:06:53 2022] GET /compute/v2.1/servers/19ef8ebe-6090-4378-a088-253fced14340 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:06:59.242248 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-66b966f8-7f93-4576-930b-9be2735cebe3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:59.246985 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-66b966f8-7f93-4576-930b-9be2735cebe3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:59.257360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66b966f8-7f93-4576-930b-9be2735cebe3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:59.258152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66b966f8-7f93-4576-930b-9be2735cebe3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:59.261116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66b966f8-7f93-4576-930b-9be2735cebe3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:59.262141 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-66b966f8-7f93-4576-930b-9be2735cebe3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:59.336993 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-66b966f8-7f93-4576-930b-9be2735cebe3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.099184 Jul 26 05:06:59.343690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 360/699] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Jul 26 05:06:59 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:06:59.429354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:59.431138 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:59.441578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:59.441965 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:59.442901 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:59.443358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:59.448199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=74 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:06:59.471444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:06:59.560454 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c5fb601f-47d2-43f2-9510-0a10cd631d82 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 204 len: 0 microversion: 2.20 time: 0.135501 Jul 26 05:06:59.561524 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 340/700] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Jul 26 05:06:59 2022] DELETE /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 05:06:59.580109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:06:59.581277 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:06:59.589196 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:59.589825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:59.590949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:06:59.595659 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:06:59.777215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:59.786109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:59.788743 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:06:59.790024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-24baad47-5926-43b5-ad4b-63a841159677 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.224090 Jul 26 05:06:59.800258 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 361/701] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:06:59 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:07:00.816457 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:00.817252 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:00.827302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:00.828254 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:00.829256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:00.829725 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:01.019838 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:01.031117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:01.033613 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:01.035239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4d4100a8-f49b-4a1c-98e4-922f4ed420a1 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1723 microversion: 2.20 time: 0.223526 Jul 26 05:07:01.036115 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 341/702] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:07:00 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:07:02.060623 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:02.061237 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:02.073331 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:02.073772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:02.074553 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:02.075001 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:02.123061 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:02.204694 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:02.215452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:02.220034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:02.223421 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6b0ad521-cca9-46ae-9c6c-605f9f6b6446 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1655 microversion: 2.20 time: 0.167136 Jul 26 05:07:02.224937 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 362/703] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:07:02 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1655 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:07:02.682530 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-fe464c32-fc16-4cc6-8401-c66227a376b3 req-1ea511e3-38e9-4868-bbb9-5fef5e430ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e577df-08fa-4428-a9a2-44458ca27e2a", "name": "network-vif-deleted", "tag": "19c54117-94e3-4ff4-a8ce-06b6514cd2e6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:02.702366 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fe464c32-fc16-4cc6-8401-c66227a376b3 req-1ea511e3-38e9-4868-bbb9-5fef5e430ae1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:02.702659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fe464c32-fc16-4cc6-8401-c66227a376b3 req-1ea511e3-38e9-4868-bbb9-5fef5e430ae1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:02.719152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-fe464c32-fc16-4cc6-8401-c66227a376b3 req-1ea511e3-38e9-4868-bbb9-5fef5e430ae1 service nova] Creating event network-vif-deleted:19c54117-94e3-4ff4-a8ce-06b6514cd2e6 for instance e2e577df-08fa-4428-a9a2-44458ca27e2a on hv-cinder-85057 Jul 26 05:07:02.725896 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-fe464c32-fc16-4cc6-8401-c66227a376b3 req-1ea511e3-38e9-4868-bbb9-5fef5e430ae1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049900 Jul 26 05:07:02.727082 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 342/704] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:03.254928 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:03.255646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:03.291231 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:03.293987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:03.299776 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:03.304010 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:03.431156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:03.436046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:03.436896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lazy-loading 'fault' on Instance uuid e2e577df-08fa-4428-a9a2-44458ca27e2a {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:07:03.531651 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:03.542818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:03.544916 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f996bed3f6064c6dbf04d26c7c04df7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27187d178a5f47b49035991ab566c2d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:03.546280 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0e6a2f06-bc00-41d2-9b23-89e8b21b4a6e tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 200 len: 1372 microversion: 2.20 time: 0.298041 Jul 26 05:07:03.562108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 363/705] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:07:03 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 05:07:04.577836 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:04.578511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:04.585239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:04.585559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:04.586336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:04.586767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:04.612540 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] HTTP exception thrown: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Request method failure captured: Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a HTTP/1.1 Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TWCkfaLpFwVzykqsIb80MiKZSyY8clU4-oJS0KfmarGK3oknqlYpX7-dlpgb5LFGptotOesQoWNLqdLWWuGB8SDZ3Awl6eKeyoZFiYwRG8iBOp5rauNIvDexju_4iMjWOLIaNmHmVLei-NQ9HrSIQiK3h2RiYxNjyuxbTMHZQIKVw Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:07:04.614590 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27187d178a5f47b49035991ab566c2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}] Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f996bed3f6064c6dbf04d26c7c04df7c Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:04.616326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'e2e577df-08fa-4428-a9a2-44458ca27e2a'} Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:04.617228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:04.618662 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:04.620728 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Returning 404 to user: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:04.620728 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d8965f7a-eda0-4522-a9c2-c9915abf8fad tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 404 len: 111 microversion: 2.20 time: 0.043379 Jul 26 05:07:04.620728 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 343/706] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:07:04 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 05:07:04.626647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b1f0076b-5ba1-4cc9-921f-8ddf61efdf6c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '.version_select at 0x7f0e950eb310>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:04.654908 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b1f0076b-5ba1-4cc9-921f-8ddf61efdf6c tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105748622" status: 204 len: 0 microversion: 2.20 time: 0.032175 Jul 26 05:07:04.656124 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 364/707] 10.222.0.17 () {60 vars in 1262 bytes} [Tue Jul 26 05:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105748622 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 05:07:06.614725 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:06.615685 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:06.628033 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:06.628495 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:06.629476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:06.630199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:06.650555 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] HTTP exception thrown: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Request method failure captured: Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a HTTP/1.1 Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TWCkfaLpFwVzykqsIb80MiKZSyY8clU4-oJS0KfmarGK3oknqlYpX7-dlpgb5LFGptotOesQoWNLqdLWWuGB8SDZ3Awl6eKeyoZFiYwRG8iBOp5rauNIvDexju_4iMjWOLIaNmHmVLei-NQ9HrSIQiK3h2RiYxNjyuxbTMHZQIKVw Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:07:06.652261 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27187d178a5f47b49035991ab566c2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}] Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f996bed3f6064c6dbf04d26c7c04df7c Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.653752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'e2e577df-08fa-4428-a9a2-44458ca27e2a'} Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:06.654559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.655972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.658566 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Returning 404 to user: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:06.658566 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f8216ae0-6d7b-42dd-a13b-58d48aa5e2fc tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 404 len: 111 microversion: 2.20 time: 0.043121 Jul 26 05:07:06.658566 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 344/708] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Jul 26 05:07:06 2022] DELETE /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:07:06.664037 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:06.664649 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: e2e577df-08fa-4428-a9a2-44458ca27e2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:06.672376 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:06.672936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:06.673817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:06.674183 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:06.709312 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] HTTP exception thrown: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Request method failure captured: Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a HTTP/1.1 Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TWCkfaLpFwVzykqsIb80MiKZSyY8clU4-oJS0KfmarGK3oknqlYpX7-dlpgb5LFGptotOesQoWNLqdLWWuGB8SDZ3Awl6eKeyoZFiYwRG8iBOp5rauNIvDexju_4iMjWOLIaNmHmVLei-NQ9HrSIQiK3h2RiYxNjyuxbTMHZQIKVw Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:07:06.711425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27187d178a5f47b49035991ab566c2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}] Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: f996bed3f6064c6dbf04d26c7c04df7c Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.713050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'e2e577df-08fa-4428-a9a2-44458ca27e2a'} Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:06.713876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. Jul 26 05:07:06.715065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:06.716164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Returning 404 to user: Instance e2e577df-08fa-4428-a9a2-44458ca27e2a could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:06.716164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-06bf53aa-bb4f-4d97-b5a5-c29b45f03aab tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a" status: 404 len: 111 microversion: 2.20 time: 0.053563 Jul 26 05:07:06.726420 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 365/709] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:07:06 2022] GET /compute/v2.1/servers/e2e577df-08fa-4428-a9a2-44458ca27e2a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:07:07.916999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:07.918187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:07.927759 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:07.928831 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:07.930188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:07.930834 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:07.950855 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] HTTP exception thrown: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Request method failure captured: Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 HTTP/1.1 Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33TWCkfaLpFwVzykqsIb80MiKZSyY8clU4-oJS0KfmarGK3oknqlYpX7-dlpgb5LFGptotOesQoWNLqdLWWuGB8SDZ3Awl6eKeyoZFiYwRG8iBOp5rauNIvDexju_4iMjWOLIaNmHmVLei-NQ9HrSIQiK3h2RiYxNjyuxbTMHZQIKVw Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:07:07.952699 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27187d178a5f47b49035991ab566c2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}] Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: f996bed3f6064c6dbf04d26c7c04df7c Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:07.954124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '02b3bcc1-fe56-4edd-b25a-a2c338610939'} Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:07.954846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:07.956140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:07:07.958705 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Returning 404 to user: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:07.959595 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cc60b19a-0f9f-408f-9970-02d78eb6fd9b tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "DELETE /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 404 len: 111 microversion: 2.20 time: 0.048073 Jul 26 05:07:07.960622 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 345/710] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Jul 26 05:07:07 2022] DELETE /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:07:07.977742 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:07.981154 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] [instance: 02b3bcc1-fe56-4edd-b25a-a2c338610939] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:07.989465 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:07.997316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:07.998211 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:08.000098 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:08.000553 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:08.043632 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] HTTP exception thrown: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Request method failure captured: Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 HTTP/1.1 Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33TWCkfaLpFwVzykqsIb80MiKZSyY8clU4-oJS0KfmarGK3oknqlYpX7-dlpgb5LFGptotOesQoWNLqdLWWuGB8SDZ3Awl6eKeyoZFiYwRG8iBOp5rauNIvDexju_4iMjWOLIaNmHmVLei-NQ9HrSIQiK3h2RiYxNjyuxbTMHZQIKVw Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:07:08.046063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_27187d178a5f47b49035991ab566c2d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/27187d178a5f47b49035991ab566c2d9"}]}] Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 27187d178a5f47b49035991ab566c2d9 Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1439849610 Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: f996bed3f6064c6dbf04d26c7c04df7c Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1439849610-project Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:08.048230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '02b3bcc1-fe56-4edd-b25a-a2c338610939'} Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:07:08.049339 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. Jul 26 05:07:08.051039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:07:08.053089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] Returning 404 to user: Instance 02b3bcc1-fe56-4edd-b25a-a2c338610939 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:07:08.054105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c30b3b4f-f71d-4327-ac42-6105e50bdcc3 tempest-AttachVolumeShelveTestJSON-1439849610 tempest-AttachVolumeShelveTestJSON-1439849610-project] 10.222.0.17 "GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939" status: 404 len: 111 microversion: 2.20 time: 0.088910 Jul 26 05:07:08.054840 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 366/711] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jul 26 05:07:07 2022] GET /compute/v2.1/servers/02b3bcc1-fe56-4edd-b25a-a2c338610939 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:07:19.712924 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:19.713646 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:19.896004 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3144293d-7a5c-4fbf-8322-ebc90897ca76 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: .version_select at 0x7f0e95029af0>, body: {"keypair": {"name": "tempest-keypair-950781690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjeo7WfynuyBBxawwNf99GYQWhL3FwfgOvHfLdHMT5gcnW3Y1UFGRVoM/+iWK48QJ4vfZOLGEkFteWGGfEUWwLJ9+RzJBfU/GyVKYWNYZLMvCxbWBFGAJmvlbc8YxEVYw=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:19.920624 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-3144293d-7a5c-4fbf-8322-ebc90897ca76 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:19.928859 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-3144293d-7a5c-4fbf-8322-ebc90897ca76 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:19.959377 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3144293d-7a5c-4fbf-8322-ebc90897ca76 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.251421 Jul 26 05:07:19.960583 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 346/712] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:07:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:21.713466 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-710638342", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "912d8cea-04c4-42a2-bd90-8733248dc6ae"}], "security_groups": [{"name": "tempest-securitygroup--1448020600"}], "key_name": "tempest-keypair-950781690", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:21.727766 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=14 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:21.857430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] validate_networks() for [('912d8cea-04c4-42a2-bd90-8733248dc6ae', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:07:22.475439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:07:22.475792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:07:22.476276 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:07:22.476899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:07:22.477530 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:07:22.490655 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.491097 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.491939 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:22.492373 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:22.514182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:22.518565 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:22.529895 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:07:22.532219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:07:22.591473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6432f62c-4b35-468a-a8b7-d7e5f92fae05 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.882375 Jul 26 05:07:22.592702 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 367/713] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:07:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:07:22.607090 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-48c594b4-4994-4200-a1c1-95631221b780 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:22.608976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-48c594b4-4994-4200-a1c1-95631221b780 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:22.690634 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-48c594b4-4994-4200-a1c1-95631221b780 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:22.699911 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-48c594b4-4994-4200-a1c1-95631221b780 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1240 microversion: 2.1 time: 0.100139 Jul 26 05:07:22.701085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 347/714] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:22 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:23.722050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:23.723680 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:23.731752 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:23.732197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:23.733496 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:23.734321 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:23.845286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:23.854298 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f5e9724a-453f-4e52-bbdb-054043855113 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1292 microversion: 2.1 time: 0.136760 Jul 26 05:07:23.855243 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 368/715] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:23 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1292 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:24.882458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:24.883408 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:24.892333 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:24.893265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:24.894164 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:24.894879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:25.008184 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:25.035226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dadb0b9f-839e-495c-a855-f14f47cc909b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1298 microversion: 2.1 time: 0.161693 Jul 26 05:07:25.049422 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 348/716] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:24 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:26.057423 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:26.058274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:26.080582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:26.081155 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:26.082533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:26.083189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:26.398323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-76dcce2b-e39b-4686-bbb5-87d8d75893b4 req-e17791bf-bf98-4af2-ae57-4a565a1cb638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bd266ba-c238-47fc-9ff2-1176d4d46a5b", "tag": "61e555f8-fed5-4569-b13d-5927a204917c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:26.429629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-76dcce2b-e39b-4686-bbb5-87d8d75893b4 req-e17791bf-bf98-4af2-ae57-4a565a1cb638 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:26.430528 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-76dcce2b-e39b-4686-bbb5-87d8d75893b4 req-e17791bf-bf98-4af2-ae57-4a565a1cb638 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:26.455157 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-76dcce2b-e39b-4686-bbb5-87d8d75893b4 req-e17791bf-bf98-4af2-ae57-4a565a1cb638 service nova] Creating event network-changed:61e555f8-fed5-4569-b13d-5927a204917c for instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b on hv-cinder-85057 Jul 26 05:07:26.461497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-76dcce2b-e39b-4686-bbb5-87d8d75893b4 req-e17791bf-bf98-4af2-ae57-4a565a1cb638 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066370 Jul 26 05:07:26.462810 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 349/717] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:07:26.570441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:26.590362 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dc60205a-d8cf-4bbf-9708-70ac4b121348 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1366 microversion: 2.1 time: 0.537589 Jul 26 05:07:26.590967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 369/718] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:26 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1366 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:27.615037 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:27.616388 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:27.630232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:27.631814 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:27.636730 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:27.637373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:27.869581 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:27.902436 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3ecb5adc-538f-4091-a0c8-a2c1e235e616 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1366 microversion: 2.1 time: 0.291952 Jul 26 05:07:27.918596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 350/719] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:27 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:28.924454 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:28.926102 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:28.934704 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:28.935237 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:28.936329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:28.936775 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:29.133509 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:29.155897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1cad3007-5238-4f94-942d-f9e7f23bfff5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1366 microversion: 2.1 time: 0.230310 Jul 26 05:07:29.156845 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 370/720] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:28 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:30.181787 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:30.184020 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:30.198129 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:30.199432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:30.201529 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:30.203518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:30.470240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:30.478092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-295dcbff-fb86-4090-9ad5-3b33cd197e0c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1366 microversion: 2.1 time: 0.302691 Jul 26 05:07:30.478644 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 351/721] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:30 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:31.499330 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:31.501132 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:31.514409 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:31.516865 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:31.517844 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:31.519351 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:31.863446 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:31.872321 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7bf41c93-1717-48d4-b6e7-b7a96f4fa9be tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1366 microversion: 2.1 time: 0.376922 Jul 26 05:07:31.875712 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 371/722] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:31 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:32.894444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:32.895077 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:32.901847 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:32.910709 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:32.914051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:32.915171 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:32.915842 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:33.133604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:33.145234 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5d1f4fce-60b1-460b-b558-051ff6daa102 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1366 microversion: 2.1 time: 0.255210 Jul 26 05:07:33.146633 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 352/723] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:32 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:33.541605 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-461d4aab-3ca6-429b-b42f-3fb3240fe76f req-03765da7-5456-43ab-a282-bac34aa6cb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd266ba-c238-47fc-9ff2-1176d4d46a5b", "name": "network-vif-plugged", "status": "completed", "tag": "61e555f8-fed5-4569-b13d-5927a204917c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:33.554355 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:33.557903 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:33.563743 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-461d4aab-3ca6-429b-b42f-3fb3240fe76f req-03765da7-5456-43ab-a282-bac34aa6cb9d service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:33.564703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-461d4aab-3ca6-429b-b42f-3fb3240fe76f req-03765da7-5456-43ab-a282-bac34aa6cb9d service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:33.605322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-461d4aab-3ca6-429b-b42f-3fb3240fe76f req-03765da7-5456-43ab-a282-bac34aa6cb9d service nova] Creating event network-vif-plugged:61e555f8-fed5-4569-b13d-5927a204917c for instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b on hv-cinder-85057 Jul 26 05:07:33.619272 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-461d4aab-3ca6-429b-b42f-3fb3240fe76f req-03765da7-5456-43ab-a282-bac34aa6cb9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086418 Jul 26 05:07:33.620654 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 372/724] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:34.188619 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:34.189243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:34.203702 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:34.205022 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:34.206282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:34.206901 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:34.444959 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:34.460061 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-86fb4072-9872-4e4d-a144-e961892605bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1366 microversion: 2.1 time: 0.281419 Jul 26 05:07:34.461978 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 353/725] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:34 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:35.484196 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:35.485179 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:35.498658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:35.499916 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:35.500858 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:35.501611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:35.824356 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:35.832261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-17a27c00-499e-4238-af73-f9a2816a1dd0 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1556 microversion: 2.1 time: 0.354647 Jul 26 05:07:35.832853 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 373/726] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:35 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1556 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:35.859824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fba1f4f7-a112-4195-ab9b-a03dbbd15d33 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:35.860523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fba1f4f7-a112-4195-ab9b-a03dbbd15d33 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:35.875409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fba1f4f7-a112-4195-ab9b-a03dbbd15d33 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:35.887439 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fba1f4f7-a112-4195-ab9b-a03dbbd15d33 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:35.891226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fba1f4f7-a112-4195-ab9b-a03dbbd15d33 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:35.893311 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fba1f4f7-a112-4195-ab9b-a03dbbd15d33 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:36.069357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fba1f4f7-a112-4195-ab9b-a03dbbd15d33 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215086 Jul 26 05:07:36.069929 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 354/727] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:07:35 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:37.945328 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-f0fbacff-d457-493e-968a-371efc190887 req-74921747-06d0-402f-9b51-bf439f63c6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bd266ba-c238-47fc-9ff2-1176d4d46a5b", "tag": "61e555f8-fed5-4569-b13d-5927a204917c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:37.967277 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-f0fbacff-d457-493e-968a-371efc190887 req-74921747-06d0-402f-9b51-bf439f63c6a8 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:37.971155 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-f0fbacff-d457-493e-968a-371efc190887 req-74921747-06d0-402f-9b51-bf439f63c6a8 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:38.000942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-f0fbacff-d457-493e-968a-371efc190887 req-74921747-06d0-402f-9b51-bf439f63c6a8 service nova] Creating event network-changed:61e555f8-fed5-4569-b13d-5927a204917c for instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b on hv-cinder-85057 Jul 26 05:07:38.012183 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-f0fbacff-d457-493e-968a-371efc190887 req-74921747-06d0-402f-9b51-bf439f63c6a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070189 Jul 26 05:07:38.014481 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 374/728] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:47.843149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:47.843927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=36 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:47.848212 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-15bda5ca-3f4a-4b4c-9ef1-e6aeb6d5f41b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Action: 'create', calling method: .version_select at 0x7f0e95075820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1120721877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLvEufxHhCQx0IEcD/0xDanMaJF4yI9BLj1GYaYijl8fUuG9G6YvHPkTbqircvAuUumvmDvE7jPZs/Po5a9FeayK1eJ7k4u8YQSwxsymSFw+u+U3Sc8NlyUs6fU+GT1Qg=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:47.870630 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-15bda5ca-3f4a-4b4c-9ef1-e6aeb6d5f41b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Getting quotas for project f1b92b49730c4ce7829e7f14b6870b43. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:47.875710 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-15bda5ca-3f4a-4b4c-9ef1-e6aeb6d5f41b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Getting quotas for user c1e8fc3655db4d428bde11a8fc70c0dc and project f1b92b49730c4ce7829e7f14b6870b43. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:47.902394 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-15bda5ca-3f4a-4b4c-9ef1-e6aeb6d5f41b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062600 Jul 26 05:07:47.911814 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 355/729] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:07:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:07:48.008778 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1213660356", "imageRef": "a44002b0-6f9a-4c8f-ae62-b75e71019342", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1120721877", "networks": [{"uuid": "222f5094-66e8-49db-b14e-07f8d8588a65"}]}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:48.018766 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:48.019831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=36 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:48.067107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] validate_networks() for [('222f5094-66e8-49db-b14e-07f8d8588a65', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:07:48.543219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:07:48.543927 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:07:48.544530 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:07:48.545039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:07:48.545551 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:07:48.563078 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:48.565623 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:48.568886 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:48.570913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:48.615608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Getting quotas for project f1b92b49730c4ce7829e7f14b6870b43. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:48.621497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Getting quotas for user c1e8fc3655db4d428bde11a8fc70c0dc and project f1b92b49730c4ce7829e7f14b6870b43. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:48.637432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:07:48.640092 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a44002b0-6f9a-4c8f-ae62-b75e71019342',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:07:48.703485 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-56a6d235-b85a-4bd2-96bf-9ed19b45f524 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698483 Jul 26 05:07:48.704788 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 375/730] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:07:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:07:48.716401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-617dd07f-60bd-46f6-a283-6a1b3e46be3c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:48.717617 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-617dd07f-60bd-46f6-a283-6a1b3e46be3c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:48.846735 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-617dd07f-60bd-46f6-a283-6a1b3e46be3c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:48.856239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-617dd07f-60bd-46f6-a283-6a1b3e46be3c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1259 microversion: 2.1 time: 0.144779 Jul 26 05:07:48.867588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 356/731] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:48 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:07:49.879750 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:49.880421 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:49.894792 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:49.896261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:49.898836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:49.899471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:50.020404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:50.030525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1884fac0-00f5-45e4-b73c-1e3774e04c6f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1311 microversion: 2.1 time: 0.155511 Jul 26 05:07:50.031647 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 376/732] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:49 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:51.055937 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:51.057724 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:51.071504 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:51.074610 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:51.082456 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:51.082456 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:51.488722 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:51.506358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4492932e-9c9b-40d8-b051-4a559e4dd2fb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.456170 Jul 26 05:07:51.509072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 357/733] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:51 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:51.706591 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d5120a02-35f1-4814-93b0-04a8d4dfd745 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Action: 'create', calling method: .version_select at 0x7f0e950cb9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-219346942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCniOz0tZeYbfHs+rrR0y5kSdthbTCpgNxSksVXPiX8bQ3DQscW70RLxfUuOJrZXV2z4vQuIVapQd1J3OpYvLaMD9T5oVY3lgR2yP/kbCiiUFvKk5AAHwwzEWLRQ579kJQ=="}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:51.816938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-d5120a02-35f1-4814-93b0-04a8d4dfd745 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Getting quotas for project 666f12ad571f45c096947d0497291842. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:07:51.832377 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-d5120a02-35f1-4814-93b0-04a8d4dfd745 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Getting quotas for user bca4c30c05b1498f861242024880f2e4 and project 666f12ad571f45c096947d0497291842. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:07:51.878207 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d5120a02-35f1-4814-93b0-04a8d4dfd745 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.601229 Jul 26 05:07:51.887837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 377/734] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:07:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:07:52.557663 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:52.562440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:52.588582 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.589284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:52.590434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:52.590824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:53.003094 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:53.023529 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3c267706-8373-4aff-81e2-8bf570a3bcc0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.494933 Jul 26 05:07:53.026512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 358/735] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:52 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:53.959195 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-ba939e05-a2c5-47fb-87ab-f76f443d1b9c req-84335cd2-aed7-41ac-8dfa-68ed63a3579a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd1067-52b6-48ec-bc52-395a0dc3139d", "tag": "3f693448-895a-4f47-a9c7-ede536579f65"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:07:53.981091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ba939e05-a2c5-47fb-87ab-f76f443d1b9c req-84335cd2-aed7-41ac-8dfa-68ed63a3579a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:53.984669 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-ba939e05-a2c5-47fb-87ab-f76f443d1b9c req-84335cd2-aed7-41ac-8dfa-68ed63a3579a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:54.023423 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-ba939e05-a2c5-47fb-87ab-f76f443d1b9c req-84335cd2-aed7-41ac-8dfa-68ed63a3579a service nova] Creating event network-changed:3f693448-895a-4f47-a9c7-ede536579f65 for instance d5bd1067-52b6-48ec-bc52-395a0dc3139d on hv-cinder-85057 Jul 26 05:07:54.037406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-ba939e05-a2c5-47fb-87ab-f76f443d1b9c req-84335cd2-aed7-41ac-8dfa-68ed63a3579a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081072 Jul 26 05:07:54.040665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 378/736] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:07:54.045967 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:54.047519 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:54.061858 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:54.063879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:54.065320 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:54.067897 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:54.472505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:54.481748 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-af535c22-2b99-4b9a-85c4-3382846b821a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.441484 Jul 26 05:07:54.483758 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 359/737] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:54 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:55.505766 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:55.506442 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:55.513542 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:55.513806 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:55.514770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:55.515395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:55.749220 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:55.766211 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-adb03561-c51f-411b-94b9-25c9292df1b5 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.264953 Jul 26 05:07:55.788687 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 379/738] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:55 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:56.796518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:56.797223 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:56.812404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:56.813243 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:56.814600 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:56.815435 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:57.018758 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:57.026695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-63a1123c-432d-4ccc-9795-4dd76223524f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.234023 Jul 26 05:07:57.027279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 360/739] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:56 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:58.048608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:58.049249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:58.055926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:58.056385 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:58.057486 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:58.057958 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:58.232763 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:58.240892 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ca4439f7-ced2-40f8-8d9b-506484bd4c32 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.196190 Jul 26 05:07:58.241471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 380/740] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:58 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:07:59.262432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:07:59.263250 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:07:59.271851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:07:59.276628 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:59.277461 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:59.278713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:07:59.279354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:07:59.444254 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:07:59.454382 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5947bf1b-6053-44c5-ae5b-47bf7f094648 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.196120 Jul 26 05:07:59.455675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 361/741] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:07:59 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:00.475913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:00.476751 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:00.479758 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:00.484455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:00.484893 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:00.485658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:00.486083 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:00.668803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:00.676833 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f4877eb6-aa41-4bf7-8ece-eb9aa8fd26c6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.204837 Jul 26 05:08:00.677321 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 381/742] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:00 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:01.699418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:01.700080 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:01.707037 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:01.707481 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:01.708294 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:01.708743 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:01.849369 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:01.857091 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-535640f2-9006-417f-aaf6-c6fa61d6441f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.162459 Jul 26 05:08:01.857659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 362/743] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:01 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:02.881118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:02.881723 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:02.885402 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=10 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:02.892005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:02.892451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:02.893224 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:02.893655 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:03.028859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:03.036674 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d8a1069f-2a81-4c0e-a069-c81847548e66 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.161456 Jul 26 05:08:03.037256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 382/744] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:02 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:04.060373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:04.061049 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:04.069652 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:04.070273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:04.071459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:04.072121 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:04.226628 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:04.234562 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f4d38d21-382b-4729-8fc3-b3ac5b3673ec tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.180225 Jul 26 05:08:04.235154 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 363/745] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:04 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:05.255250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:05.255881 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:05.262881 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:05.263322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:05.264121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:05.264546 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:05.404828 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:05.412567 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-80284996-e1a0-4fcb-ad8c-ca7d3e79a308 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.161317 Jul 26 05:08:05.413144 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 383/746] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:05 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:06.434014 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:06.434738 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:06.442083 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:06.442540 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:06.443316 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:06.443819 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:06.581358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:06.589124 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6fa4e673-e45d-40c5-ac84-3ab6dc22136b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.159519 Jul 26 05:08:06.589697 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 364/747] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:06 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:07.374249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-6a901529-1187-4c49-a572-fcd67e2d5d5a req-fa95e698-29bc-41a1-ab82-5c687faf28a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd1067-52b6-48ec-bc52-395a0dc3139d", "name": "network-vif-plugged", "status": "completed", "tag": "3f693448-895a-4f47-a9c7-ede536579f65"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:07.384627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-6a901529-1187-4c49-a572-fcd67e2d5d5a req-fa95e698-29bc-41a1-ab82-5c687faf28a5 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:07.385069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-6a901529-1187-4c49-a572-fcd67e2d5d5a req-fa95e698-29bc-41a1-ab82-5c687faf28a5 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:07.398794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-6a901529-1187-4c49-a572-fcd67e2d5d5a req-fa95e698-29bc-41a1-ab82-5c687faf28a5 service nova] Creating event network-vif-plugged:3f693448-895a-4f47-a9c7-ede536579f65 for instance d5bd1067-52b6-48ec-bc52-395a0dc3139d on hv-cinder-85057 Jul 26 05:08:07.404024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-6a901529-1187-4c49-a572-fcd67e2d5d5a req-fa95e698-29bc-41a1-ab82-5c687faf28a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033477 Jul 26 05:08:07.404633 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 384/748] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:07.610660 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:07.611284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:07.617799 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:07.618241 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:07.619001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:07.619424 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:07.787070 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:07.794994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6a34fbe3-ee39-4d6e-98ac-ce8a464f87ce tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.188340 Jul 26 05:08:07.795540 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 365/749] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:07 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:08.818902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:08.819532 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:08.827552 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:08.828083 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:08.828937 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:08.829422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:08.990175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:08.998046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-024140ed-16a5-4a2e-999d-30b1ff5e9d09 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.184481 Jul 26 05:08:08.998719 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 385/750] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:08 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:10.020921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:10.021601 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:10.028909 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:10.029402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:10.030255 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:10.030738 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:10.186905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:10.194801 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2a82f96f-a07f-413d-a266-7798eda85251 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.179059 Jul 26 05:08:10.195380 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 366/751] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:10 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:11.217189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:11.217963 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:11.225331 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:11.225801 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:11.226561 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:11.226996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:11.369638 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:11.379428 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6874d5a0-43b5-45ec-8df7-f3ecceda554f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1359 microversion: 2.1 time: 0.166911 Jul 26 05:08:11.380119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 386/752] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:11 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:12.400813 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:12.401440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:12.407914 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.408348 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.409101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.409517 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.545069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:12.553116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f9188dc2-872c-4e0b-a15b-705cf4084f5e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1549 microversion: 2.1 time: 0.156185 Jul 26 05:08:12.553828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 367/753] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:12 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:12.575718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:12.576411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:12.583349 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.583831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.584608 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.585035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.726318 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:12.734512 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f46864f5-abd7-4d64-b62b-ecdc59146814 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1549 microversion: 2.1 time: 0.162904 Jul 26 05:08:12.736152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 387/754] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:12 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:08:12.756495 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:12.761259 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:12.762021 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Searching by: {'deleted': False, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43'} {{(pid=117993) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 05:08:12.769219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.769371 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.770049 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.770471 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.862768 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.multi_cell_list [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 05:08:12.959142 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b2b48eb5-0ec8-4798-a32a-de3e72523ebe tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206346 Jul 26 05:08:12.959713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 368/755] 10.222.0.17 () {58 vars in 1125 bytes} [Tue Jul 26 05:08:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:12.972048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:12.972656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:12.979999 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.980439 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:12.981214 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:12.981639 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:13.124769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:13.133652 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-777b95d7-e26a-44a5-bd6a-9792304bdda2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1549 microversion: 2.1 time: 0.165576 Jul 26 05:08:13.134196 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 388/756] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:12 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:13.256492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1089737519", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-219346942", "security_groups": [{"name": "tempest-secgroup-smoke-2054892163"}], "networks": [{"uuid": "72b54b76-e074-4ca5-ae69-4055afca29ba"}], "block_device_mapping_v2": [{"uuid": "e402f368-6e07-4f08-90cc-2a491550cf29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:13.559107 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] validate_networks() for [('72b54b76-e074-4ca5-ae69-4055afca29ba', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:08:13.581329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-642c2515-ace2-4408-9f01-358523995885 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:13.581886 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-642c2515-ace2-4408-9f01-358523995885 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:13.588648 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-642c2515-ace2-4408-9f01-358523995885 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:13.589205 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-642c2515-ace2-4408-9f01-358523995885 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:13.589980 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-642c2515-ace2-4408-9f01-358523995885 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:13.590494 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-642c2515-ace2-4408-9f01-358523995885 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:13.613904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-642c2515-ace2-4408-9f01-358523995885 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/ips" status: 200 len: 149 microversion: 2.1 time: 0.036417 Jul 26 05:08:13.614582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 389/757] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:08:13 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:08:14.094970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:08:14.095434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:08:14.095971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:08:14.096339 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:08:14.096747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:08:14.105940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:14.106384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:14.107149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:14.107601 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:14.124444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Getting quotas for project 666f12ad571f45c096947d0497291842. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:08:14.129242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Getting quotas for user bca4c30c05b1498f861242024880f2e4 and project 666f12ad571f45c096947d0497291842. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:08:14.195249 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:08:14.197436 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e402f368-6e07-4f08-90cc-2a491550cf29',volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:08:14.356901 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-09741a0f-b7bf-4e2f-aa34-29cb6c53ea1b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.104351 Jul 26 05:08:14.358097 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 369/758] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:08:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:08:14.368684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-68dcfadf-e484-4eea-adde-bb9e98293772 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:14.369291 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-68dcfadf-e484-4eea-adde-bb9e98293772 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:14.423539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-68dcfadf-e484-4eea-adde-bb9e98293772 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:14.430534 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-68dcfadf-e484-4eea-adde-bb9e98293772 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1088 microversion: 2.1 time: 0.065920 Jul 26 05:08:14.431504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 390/759] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:14 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:15.452412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:15.452984 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:15.459796 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:15.460239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:15.460995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:15.461411 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:15.543433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:15.551361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3bcc6e10-b180-488e-b1de-d593e7b0d7e9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1186 microversion: 2.1 time: 0.103379 Jul 26 05:08:15.551869 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 370/760] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:15 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1186 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:16.054323 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a9f37363-b9db-4eae-9eae-c6073a19053d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5025d7a3-2359-4089-a90b-271ffc194be7"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:16.057189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a9f37363-b9db-4eae-9eae-c6073a19053d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:16.068252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9f37363-b9db-4eae-9eae-c6073a19053d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:16.068773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9f37363-b9db-4eae-9eae-c6073a19053d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:16.070682 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9f37363-b9db-4eae-9eae-c6073a19053d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:16.071500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a9f37363-b9db-4eae-9eae-c6073a19053d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:16.147502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-367148360", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-650642350", "security_groups": [{"name": "tempest-secgroup-smoke-2144158790"}], "block_device_mapping_v2": [{"uuid": "b902c392-3f89-460b-ae0e-d21e7d5bfcbe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "51ac167e-d2d0-4324-aecb-2b52bb6a1ed2"}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:16.316926 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] validate_networks() for [('51ac167e-d2d0-4324-aecb-2b52bb6a1ed2', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:08:16.354363 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a9f37363-b9db-4eae-9eae-c6073a19053d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306279 Jul 26 05:08:16.355092 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 391/761] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:08:16 2022] POST /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:16.578720 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:16.579949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:16.589341 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:16.589794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:16.590561 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:16.591198 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:16.868950 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:16.883016 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5450259e-c227-4dca-94f1-86f285d79dc1 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1272 microversion: 2.1 time: 0.310273 Jul 26 05:08:16.883830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 392/762] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:16 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1272 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:08:16.959460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6eb0bcf0-d1da-4b0f-87f4-d0076dff8bd9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa0a9c6-a635-4f13-8a7c-a1aca049e51b"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:16.961987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6eb0bcf0-d1da-4b0f-87f4-d0076dff8bd9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:16.968672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcf0-d1da-4b0f-87f4-d0076dff8bd9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:16.969204 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcf0-d1da-4b0f-87f4-d0076dff8bd9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:16.970017 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcf0-d1da-4b0f-87f4-d0076dff8bd9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:16.970764 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6eb0bcf0-d1da-4b0f-87f4-d0076dff8bd9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:17.253266 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:17.278838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6eb0bcf0-d1da-4b0f-87f4-d0076dff8bd9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323254 Jul 26 05:08:17.279472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 393/763] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:08:16 2022] POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:08:17.508534 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:08:17.509024 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:08:17.509362 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:08:17.509871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:08:17.510734 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:08:17.520020 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:17.520460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:17.521240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:17.521665 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:17.538771 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for project 987757bb89e64419822e021b15a65c31. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:08:17.542594 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Getting quotas for user 148ea5a9b7a74172b290696be99aa5c1 and project 987757bb89e64419822e021b15a65c31. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:08:17.601639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:08:17.603686 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b902c392-3f89-460b-ae0e-d21e7d5bfcbe',volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:08:17.736724 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7f0bc9d4-e5cf-4d99-ae35-c5739ee4437b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.593633 Jul 26 05:08:17.744080 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 371/764] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:08:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 05:08:17.749422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6df894a8-8047-49b4-a90f-78e2b24e70a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:17.750120 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6df894a8-8047-49b4-a90f-78e2b24e70a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:17.853615 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6df894a8-8047-49b4-a90f-78e2b24e70a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:17.861956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6df894a8-8047-49b4-a90f-78e2b24e70a3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1093 microversion: 2.1 time: 0.116508 Jul 26 05:08:17.863023 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 394/765] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:17 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1093 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:17.906693 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:17.907307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:17.909693 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:17.918722 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:17.920012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:17.921450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:17.922209 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:17.927343 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=85 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:18.137774 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-22f1b976-5f24-43f6-b0e8-083b29d52a3f req-8f6c4a29-c49f-4fdb-bc4e-6feef94fadcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12542af7-79b9-4279-ae59-c5ea7941522f", "tag": "f68c75a3-31f1-4414-8479-ccad9fcbea7a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:18.163361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:18.173951 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:18.194926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-22f1b976-5f24-43f6-b0e8-083b29d52a3f req-8f6c4a29-c49f-4fdb-bc4e-6feef94fadcd service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:18.195444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-22f1b976-5f24-43f6-b0e8-083b29d52a3f req-8f6c4a29-c49f-4fdb-bc4e-6feef94fadcd service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:18.199220 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-02c3dd12-ebff-496c-8658-149b33f692f2 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.289919 Jul 26 05:08:18.201824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 372/766] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:17 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:18.208215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-22f1b976-5f24-43f6-b0e8-083b29d52a3f req-8f6c4a29-c49f-4fdb-bc4e-6feef94fadcd service nova] Creating event network-changed:f68c75a3-31f1-4414-8479-ccad9fcbea7a for instance 12542af7-79b9-4279-ae59-c5ea7941522f on hv-cinder-85057 Jul 26 05:08:18.214274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-22f1b976-5f24-43f6-b0e8-083b29d52a3f req-8f6c4a29-c49f-4fdb-bc4e-6feef94fadcd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081480 Jul 26 05:08:18.215187 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 395/767] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:08:18.887269 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:18.887915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:18.895616 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:18.896191 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:18.896954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:18.897385 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:18.964505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:18.973182 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c2ac367e-ece8-4326-9131-f2f645b0d8d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1199 microversion: 2.1 time: 0.092108 Jul 26 05:08:18.973748 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 373/768] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:18 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:19.229023 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:19.229577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:19.239068 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:19.239513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:19.240591 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:19.241203 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:19.566397 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:19.578815 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2298dad7-8ff2-4376-af68-447b408c7ed4 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.354578 Jul 26 05:08:19.579678 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 396/769] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:19 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:19.998467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:19.999039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:20.005774 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:20.006220 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:20.006988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:20.007413 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:20.114231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:20.122104 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-719e3662-0088-4e3d-b7c4-e7d1a4092191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1209 microversion: 2.1 time: 0.127676 Jul 26 05:08:20.122670 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 374/770] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:19 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:20.612037 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:20.613069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:20.622551 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:20.623263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:20.624092 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:20.624822 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:20.841939 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:20.850180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6471810b-30b1-45a6-a7ae-a33e9b110dfb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.245891 Jul 26 05:08:20.850867 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 397/771] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:20 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:21.143971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:21.144828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:21.151845 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:21.152364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:21.153366 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:21.153869 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:21.217313 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-73c41ab3-e7b0-49e2-b0fc-3fd1ed72c679 req-d0fabb1a-3d2e-4ce1-9c12-7d036dffbaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313fe975-da61-49f7-8aeb-a95dc753e91b", "tag": "c14c64c8-333d-4bb0-9882-bbe52bc258dc"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:21.230683 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-73c41ab3-e7b0-49e2-b0fc-3fd1ed72c679 req-d0fabb1a-3d2e-4ce1-9c12-7d036dffbaae service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:21.231455 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-73c41ab3-e7b0-49e2-b0fc-3fd1ed72c679 req-d0fabb1a-3d2e-4ce1-9c12-7d036dffbaae service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:21.249122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-73c41ab3-e7b0-49e2-b0fc-3fd1ed72c679 req-d0fabb1a-3d2e-4ce1-9c12-7d036dffbaae service nova] Creating event network-changed:c14c64c8-333d-4bb0-9882-bbe52bc258dc for instance 313fe975-da61-49f7-8aeb-a95dc753e91b on hv-cinder-85057 Jul 26 05:08:21.256029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-73c41ab3-e7b0-49e2-b0fc-3fd1ed72c679 req-d0fabb1a-3d2e-4ce1-9c12-7d036dffbaae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042914 Jul 26 05:08:21.257311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 398/772] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:21.363639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:21.371344 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e53fe29e-1a95-42e6-9f72-516f6898035e tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.231737 Jul 26 05:08:21.371966 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 375/773] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:21 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:21.871246 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:21.872015 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:21.879468 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:21.879926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:21.880714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:21.881146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:22.126533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:22.135230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-e0e254c1-b97f-455e-b163-9dd412823173 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.268255 Jul 26 05:08:22.135884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 399/774] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:21 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:22.393562 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:22.394176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:22.401731 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:22.402172 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:22.402936 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:22.403361 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:22.549238 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:22.557462 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-24c0794f-6f7d-432f-9841-592acc7d0a1b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.167942 Jul 26 05:08:22.558072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 376/775] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:22 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:23.158302 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:23.158920 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:23.166303 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:23.166716 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:23.167470 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:23.167917 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:23.310531 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:23.318894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-36ecb5a2-bb64-45ec-89e3-c9b33ea00472 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.166133 Jul 26 05:08:23.319589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 400/776] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:23 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:23.579350 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:23.579946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:23.586760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:23.587201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:23.588007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:23.588431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:23.723615 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:23.732314 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bb0e2c93-274c-43bd-805d-bf90af177711 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.157735 Jul 26 05:08:23.732895 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 377/777] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:23 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:08:23.946391 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4867014e-b0c7-472c-a529-532bc5f0af89 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: .version_select at 0x7f0e9508cdc0>, body: {"keypair": {"name": "tempest-keypair-1771264776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdmoZdH6vNFGZZFMevXXltgu7x8DPpBp18lhGbKgee+4DdszOn5nqsPfihBDQVKLE/RDZtGkiVoqXOS/w6tS6FwLuPzrDtsO5wXVANswk3VpOGwXhjq+erA/1chKTzD3Q=="}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:23.963100 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-4867014e-b0c7-472c-a529-532bc5f0af89 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:08:23.967656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-4867014e-b0c7-472c-a529-532bc5f0af89 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:08:23.994714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4867014e-b0c7-472c-a529-532bc5f0af89 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052397 Jul 26 05:08:23.995358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 401/778] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:08:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:24.343171 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:24.344313 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:24.350631 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:24.351083 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:24.351882 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:24.352315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:24.566781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:24.579204 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-15e875c6-ed61-4d18-bf50-045117566e9b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.238250 Jul 26 05:08:24.579836 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 378/779] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:24 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:24.754414 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:24.755037 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:24.764556 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:24.765588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:24.766732 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:24.767600 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:25.201161 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:25.210188 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-233e390e-9260-4091-902d-e06fc7a81304 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.460596 Jul 26 05:08:25.210842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 402/780] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:24 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:25.602675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:25.603477 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:25.610571 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:25.611153 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:25.611972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:25.612407 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:25.759468 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:25.767591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f852147f-7d6f-44c6-9f06-ad1b41bb7129 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.168869 Jul 26 05:08:25.768584 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 379/781] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:25 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:25.787789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-520123666", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "912d8cea-04c4-42a2-bd90-8733248dc6ae"}], "security_groups": [{"name": "tempest-securitygroup--1269401269"}], "key_name": "tempest-keypair-1771264776", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:25.892218 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] validate_networks() for [('912d8cea-04c4-42a2-bd90-8733248dc6ae', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:08:26.234046 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:26.234694 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:26.241270 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.242067 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.242525 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.242961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.291730 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:08:26.292230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:08:26.292803 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:08:26.293380 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:08:26.293863 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:08:26.303622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.304157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.305144 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.305956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.323521 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:08:26.327970 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:08:26.340006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:08:26.342317 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:08:26.383409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:26.390977 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-772a02b2-7cfd-4c08-96ca-b1ceec2a4889 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.607630 Jul 26 05:08:26.392011 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 403/782] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:08:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:08:26.392734 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1394ef7d-a485-4ee9-9e68-1b5c1515fc56 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.162547 Jul 26 05:08:26.395606 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 380/783] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:26 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:26.402450 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b4e7dfd5-5b06-469c-80fd-98c5aa9fec10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:26.403067 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b4e7dfd5-5b06-469c-80fd-98c5aa9fec10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:26.458637 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b4e7dfd5-5b06-469c-80fd-98c5aa9fec10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:26.465560 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b4e7dfd5-5b06-469c-80fd-98c5aa9fec10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1241 microversion: 2.1 time: 0.066950 Jul 26 05:08:26.466322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 404/784] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:26 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:26.788907 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:26.789474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:26.796144 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.796505 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.797444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:26.797890 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:26.945635 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:26.953528 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ee7b6793-f13b-4f56-810d-109dc4105348 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.168594 Jul 26 05:08:26.954087 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 381/785] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:26 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:27.418243 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:27.419888 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:27.428453 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.429308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:27.430994 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.431828 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:27.486901 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:27.487819 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:27.494794 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.495606 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:27.496638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.497329 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:27.529884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:27.550120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=12 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:27.619584 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:27.628417 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5f6269bf-9a51-4e4a-ab73-42e66516bb5d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1301 microversion: 2.1 time: 0.145647 Jul 26 05:08:27.629204 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 382/786] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:27 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1301 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:27.684827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:27.694012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f8f650ab-8b9b-44af-8047-c630ab299eea tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.283174 Jul 26 05:08:27.694582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 405/787] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:27 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:27.974408 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:27.975814 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:27.982853 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.983588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:27.984538 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:27.985122 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.207658 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:28.215957 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5c6e7794-de72-4fba-b0e0-e1c97c9957fa tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.245365 Jul 26 05:08:28.216689 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 383/788] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:27 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:28.651309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:28.651988 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:28.661184 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:28.661627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.662584 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:28.663203 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.718612 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:28.719841 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:28.726201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:28.726645 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.727401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:28.728043 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:28.980008 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:28.987935 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7a0ffea3-d810-4dd6-b481-ea2f64aa9757 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.341197 Jul 26 05:08:28.988512 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 406/789] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:28 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:29.028920 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:29.037975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c95efb6b-803d-43f5-b633-ab4fbd22f779 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.323467 Jul 26 05:08:29.038982 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 384/790] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:28 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:29.237590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:29.238303 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:29.245424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.245879 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.246930 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.247635 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.442212 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-fd4f8637-0fcb-4ac2-9de4-38d1fa441ab7 req-16b6bbeb-da61-4a2a-a7b5-a093287a9ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12542af7-79b9-4279-ae59-c5ea7941522f", "name": "network-vif-plugged", "status": "completed", "tag": "f68c75a3-31f1-4414-8479-ccad9fcbea7a"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:29.457493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fd4f8637-0fcb-4ac2-9de4-38d1fa441ab7 req-16b6bbeb-da61-4a2a-a7b5-a093287a9ba6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.460035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fd4f8637-0fcb-4ac2-9de4-38d1fa441ab7 req-16b6bbeb-da61-4a2a-a7b5-a093287a9ba6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.474485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-fd4f8637-0fcb-4ac2-9de4-38d1fa441ab7 req-16b6bbeb-da61-4a2a-a7b5-a093287a9ba6 service nova] Creating event network-vif-plugged:f68c75a3-31f1-4414-8479-ccad9fcbea7a for instance 12542af7-79b9-4279-ae59-c5ea7941522f on hv-cinder-85057 Jul 26 05:08:29.481137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-fd4f8637-0fcb-4ac2-9de4-38d1fa441ab7 req-16b6bbeb-da61-4a2a-a7b5-a093287a9ba6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043391 Jul 26 05:08:29.482621 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 385/791] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:29.489429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-978ce9e2-af91-48a9-93d8-ac6b67218216 req-42e88dbb-fa0d-420b-af73-5810848ca563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111ba5fc-f989-4373-b60a-59c603db68c7", "tag": "1062f18d-357b-4737-945e-a6d026c01d69"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:29.500471 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-978ce9e2-af91-48a9-93d8-ac6b67218216 req-42e88dbb-fa0d-420b-af73-5810848ca563 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:29.501344 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-978ce9e2-af91-48a9-93d8-ac6b67218216 req-42e88dbb-fa0d-420b-af73-5810848ca563 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:29.512430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:29.515005 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-978ce9e2-af91-48a9-93d8-ac6b67218216 req-42e88dbb-fa0d-420b-af73-5810848ca563 service nova] Creating event network-changed:1062f18d-357b-4737-945e-a6d026c01d69 for instance 111ba5fc-f989-4373-b60a-59c603db68c7 on hv-cinder-85057 Jul 26 05:08:29.521868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-978ce9e2-af91-48a9-93d8-ac6b67218216 req-42e88dbb-fa0d-420b-af73-5810848ca563 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037617 Jul 26 05:08:29.522976 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 386/792] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:29.523123 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-00c26cd6-81ae-4bbf-bcfd-bb055099d22a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.289649 Jul 26 05:08:29.533214 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 407/793] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:29 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:30.012037 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:30.012749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:30.020374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.020824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.021593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.022024 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.059068 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:30.059673 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:30.066696 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.067171 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.068053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.068452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.318552 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:30.328123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bbe52581-db97-4807-8f87-0a2d2c65b28b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.321047 Jul 26 05:08:30.328915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 387/794] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:30 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:30.425848 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:30.433797 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-aedf87be-b5b7-40e5-805f-9578c3106fe0 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1277 microversion: 2.1 time: 0.379052 Jul 26 05:08:30.434444 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 408/795] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:30 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1277 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:30.544663 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:30.545295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:30.552106 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.552547 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.553307 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:30.553734 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:30.687978 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:30.695842 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3690a8b1-fc48-47d1-979f-909e025e6375 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.155117 Jul 26 05:08:30.696486 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 388/796] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:30 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:31.316043 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:31.316748 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:31.323334 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.323823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.324598 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.325035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.351908 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:31.353373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:31.361708 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.362836 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.363818 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.364358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.588404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:31.593723 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:31.597798 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9dc0eb18-6d9f-43d5-8a84-d240461d6640 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1595 microversion: 2.1 time: 0.285567 Jul 26 05:08:31.598475 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 409/797] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:31 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1595 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:31.602899 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d4fd86a2-20cf-4e27-9b0d-3fb76326ac71 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.255522 Jul 26 05:08:31.603165 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:31.603775 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:31.606767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 389/798] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:31 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:31.613548 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.614499 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.616164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.617797 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.717133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:31.717823 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:31.724433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.724863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.725663 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:31.726069 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:31.730326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:31.756537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:31.772178 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4408c168-06bd-447c-894e-720db4ee79bd tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.172627 Jul 26 05:08:31.779049 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 410/799] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:31 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:31.876927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:31.884559 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1902c2d6-997c-4ddf-90c9-3333c65fd3a8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1260 microversion: 2.1 time: 0.171981 Jul 26 05:08:31.885130 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 390/800] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:31 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:08:32.624829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:32.625636 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:32.632790 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.633411 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.634321 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.634875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.795123 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:32.796209 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:32.802830 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.803416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:32.804315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:32.804847 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:33.143318 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:33.152548 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c1c9f84b-8fe7-4f62-8095-1f107815d59d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.531886 Jul 26 05:08:33.153105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 411/801] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:32 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:33.159521 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:33.160403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:33.168617 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:33.169317 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:33.170301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:33.170735 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:33.327369 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:33.335828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8d28a88b-dc87-40e4-9761-1b260f5ab512 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.545170 Jul 26 05:08:33.336832 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 391/802] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:32 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:08:33.361145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:33.369986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-80fe08ff-7972-4792-ac4d-a9bdc5779738 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1444 microversion: 2.1 time: 0.215580 Jul 26 05:08:33.370567 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 412/803] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:33 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1444 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:33.391108 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:33.391545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:33.397967 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:33.398400 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:33.399168 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:33.399584 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:33.543460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:33.551868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-50f1f957-0e5f-4252-95c4-8bf405f85d84 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1444 microversion: 2.1 time: 0.164710 Jul 26 05:08:33.552464 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 392/804] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:33 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:33.654198 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-d5d86165-6331-4278-92f0-ff03d1a06b2e req-90c59b86-e4ed-4dfa-bcbe-beb6e4ac5825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd1067-52b6-48ec-bc52-395a0dc3139d", "tag": "3f693448-895a-4f47-a9c7-ede536579f65"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:33.666056 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d5d86165-6331-4278-92f0-ff03d1a06b2e req-90c59b86-e4ed-4dfa-bcbe-beb6e4ac5825 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:33.666589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d5d86165-6331-4278-92f0-ff03d1a06b2e req-90c59b86-e4ed-4dfa-bcbe-beb6e4ac5825 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:33.679397 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-d5d86165-6331-4278-92f0-ff03d1a06b2e req-90c59b86-e4ed-4dfa-bcbe-beb6e4ac5825 service nova] Creating event network-changed:3f693448-895a-4f47-a9c7-ede536579f65 for instance d5bd1067-52b6-48ec-bc52-395a0dc3139d on hv-cinder-85057 Jul 26 05:08:33.686199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-d5d86165-6331-4278-92f0-ff03d1a06b2e req-90c59b86-e4ed-4dfa-bcbe-beb6e4ac5825 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035643 Jul 26 05:08:33.687048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 413/805] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:34.189256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:34.190762 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:34.200913 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:34.202678 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:34.204095 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:34.205937 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:34.359014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:34.359903 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:34.371825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:34.374776 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:34.375891 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:34.376495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:34.732440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:34.741327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f8796105-c6cd-47e5-a2cf-d9ba8596c564 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.557436 Jul 26 05:08:34.755492 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 393/806] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:34 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:34.964234 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:34.979651 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0dcc1ffb-5f74-48db-a1ad-05ec6dd056c3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.625048 Jul 26 05:08:34.980991 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 414/807] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:34 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:35.023840 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1149990353"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:35.027733 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:35.034213 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:35.034654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:35.035539 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:35.038696 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:35.378234 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.network.security_group_api [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Adding security group 839a28ae-e766-494c-b5a7-9539507d6d06 to port 3f693448-895a-4f47-a9c7-ede536579f65 Jul 26 05:08:35.762508 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:35.763114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:35.770039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:35.770437 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:35.771202 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:35.771670 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:35.792552 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:36.128789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:36.136945 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-061ff5d7-5ac3-46bb-8dbf-054051390004 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.378326 Jul 26 05:08:36.137718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 415/808] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:35 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:36.142587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:36.143613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:36.150091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:36.150594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:36.151301 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:36.151965 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:36.179319 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1a259b4b-8b1e-4d63-b546-2e2d793cc932 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/action" status: 202 len: 0 microversion: 2.1 time: 1.159272 Jul 26 05:08:36.183960 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 394/809] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:08:35 2022] POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/action => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:08:36.189694 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:36.190529 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:36.197958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:36.198659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:36.199629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:36.200237 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:36.313367 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:36.463638 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=16 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:36.862950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:36.867796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:36.879044 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-10122c26-649f-4718-ab24-c693be8b7016 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.740059 Jul 26 05:08:36.885432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-383716ce-b744-4d27-b806-a15971ef35ea tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1760 microversion: 2.1 time: 0.700145 Jul 26 05:08:36.886295 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 416/810] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:36 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:36.891119 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-a95f9a8b-8680-43db-92d1-6d9dd6f39871 req-d4c851c1-736b-446a-9ad6-df7f172dba4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd1067-52b6-48ec-bc52-395a0dc3139d", "tag": "3f693448-895a-4f47-a9c7-ede536579f65"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:36.892450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 395/811] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:36 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1760 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:36.901752 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a95f9a8b-8680-43db-92d1-6d9dd6f39871 req-d4c851c1-736b-446a-9ad6-df7f172dba4a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:36.902187 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a95f9a8b-8680-43db-92d1-6d9dd6f39871 req-d4c851c1-736b-446a-9ad6-df7f172dba4a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:36.914551 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-a95f9a8b-8680-43db-92d1-6d9dd6f39871 req-d4c851c1-736b-446a-9ad6-df7f172dba4a service nova] Creating event network-changed:3f693448-895a-4f47-a9c7-ede536579f65 for instance d5bd1067-52b6-48ec-bc52-395a0dc3139d on hv-cinder-85057 Jul 26 05:08:36.919823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-a95f9a8b-8680-43db-92d1-6d9dd6f39871 req-d4c851c1-736b-446a-9ad6-df7f172dba4a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032189 Jul 26 05:08:36.920748 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 417/812] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:37.170311 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:37.170987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:37.177428 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:37.177969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:37.178776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:37.179297 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:37.462794 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:37.470671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7e5ff593-c622-499d-8f3a-f9f2915dc0cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.304377 Jul 26 05:08:37.471238 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 396/813] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:37 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:37.907577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:37.908287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:37.915013 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:37.915448 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:37.916261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:37.916681 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:38.051152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:38.059216 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0098833f-21d5-42ef-87be-6b81d97a1d8a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.156387 Jul 26 05:08:38.059780 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 418/814] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:37 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:38.492727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:38.493510 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:38.500502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:38.500950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:38.501761 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:38.502195 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:38.653465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:38.663543 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-36ab39dd-3bad-43d0-96b4-aa4de04fe3ed tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.174216 Jul 26 05:08:38.664233 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 397/815] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:38 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:38.952162 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-bc34d6ca-3663-4da4-a36d-9dd1014ebbe8 req-ce70fa27-e005-4b97-84ef-d938cc68bfaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12542af7-79b9-4279-ae59-c5ea7941522f", "tag": "f68c75a3-31f1-4414-8479-ccad9fcbea7a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:38.966475 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-bc34d6ca-3663-4da4-a36d-9dd1014ebbe8 req-ce70fa27-e005-4b97-84ef-d938cc68bfaf service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:38.966917 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-bc34d6ca-3663-4da4-a36d-9dd1014ebbe8 req-ce70fa27-e005-4b97-84ef-d938cc68bfaf service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:38.978559 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-bc34d6ca-3663-4da4-a36d-9dd1014ebbe8 req-ce70fa27-e005-4b97-84ef-d938cc68bfaf service nova] Creating event network-changed:f68c75a3-31f1-4414-8479-ccad9fcbea7a for instance 12542af7-79b9-4279-ae59-c5ea7941522f on hv-cinder-85057 Jul 26 05:08:38.983587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-bc34d6ca-3663-4da4-a36d-9dd1014ebbe8 req-ce70fa27-e005-4b97-84ef-d938cc68bfaf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035389 Jul 26 05:08:38.984179 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 419/816] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:39.081255 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:39.081907 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:39.089869 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.090324 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.091104 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.091541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.302186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:39.315411 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8f1a25f7-0069-403d-ab56-a24e6f500467 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.237696 Jul 26 05:08:39.331374 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 398/817] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:39 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:39.429924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-6274336b-d953-4ef1-946f-dfe08448292c req-94486bb8-a29c-4f6f-8e8c-fc5eb5d1db3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111ba5fc-f989-4373-b60a-59c603db68c7", "name": "network-vif-plugged", "status": "completed", "tag": "1062f18d-357b-4737-945e-a6d026c01d69"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:39.440776 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-6274336b-d953-4ef1-946f-dfe08448292c req-94486bb8-a29c-4f6f-8e8c-fc5eb5d1db3f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.441285 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-6274336b-d953-4ef1-946f-dfe08448292c req-94486bb8-a29c-4f6f-8e8c-fc5eb5d1db3f service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.457404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-6274336b-d953-4ef1-946f-dfe08448292c req-94486bb8-a29c-4f6f-8e8c-fc5eb5d1db3f service nova] Creating event network-vif-plugged:1062f18d-357b-4737-945e-a6d026c01d69 for instance 111ba5fc-f989-4373-b60a-59c603db68c7 on hv-cinder-85057 Jul 26 05:08:39.462583 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-6274336b-d953-4ef1-946f-dfe08448292c req-94486bb8-a29c-4f6f-8e8c-fc5eb5d1db3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036902 Jul 26 05:08:39.463533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 420/818] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:39.685387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:39.685991 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:39.695309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.696063 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.697503 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:39.698083 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:39.871372 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:39.883463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4c1e805e-a9d4-42fc-a4d8-be286770cbf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.201773 Jul 26 05:08:39.884285 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 399/819] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:39 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:40.344827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:40.345513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:40.352779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:40.353225 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:40.353998 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:40.354433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:40.501560 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:40.510063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0091493d-776f-4558-85f2-b01c5650494b tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.169423 Jul 26 05:08:40.510639 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 421/820] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:40 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:40.909231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:40.909858 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:40.916958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:40.917411 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:40.918181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:40.918622 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:41.056566 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:41.067690 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cf5475e0-1e88-4365-a039-de86e1fafaf5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1367 microversion: 2.1 time: 0.162903 Jul 26 05:08:41.068259 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 400/821] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:40 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:41.532428 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:41.533041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:41.540041 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:41.540459 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:41.541250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:41.541678 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:41.694547 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:41.702728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5f5c664f-843b-40bd-80d3-711748586e01 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.174232 Jul 26 05:08:41.703510 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 422/822] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:41 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:42.088575 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:42.089222 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:42.095990 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.096451 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.097223 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.097684 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.235473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:42.243335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-00210bd5-96ed-49e9-a6fe-7a654f3ac13b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1558 microversion: 2.1 time: 0.158747 Jul 26 05:08:42.243943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 401/823] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:42 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:42.264078 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-028878c6-a47b-411e-95a9-0b0a5003ed9d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:42.264571 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-028878c6-a47b-411e-95a9-0b0a5003ed9d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:42.271110 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-028878c6-a47b-411e-95a9-0b0a5003ed9d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.271575 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-028878c6-a47b-411e-95a9-0b0a5003ed9d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.272338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-028878c6-a47b-411e-95a9-0b0a5003ed9d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.272772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-028878c6-a47b-411e-95a9-0b0a5003ed9d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.354103 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-028878c6-a47b-411e-95a9-0b0a5003ed9d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093994 Jul 26 05:08:42.354726 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 423/824] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:08:42 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:42.724607 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:42.725227 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:42.731752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.732227 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.733039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:42.733474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:42.996482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:43.004940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-76922927-ed08-4912-ad5d-19fb44d477e6 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.284240 Jul 26 05:08:43.005664 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 402/825] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:42 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:43.443915 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-76a65752-6356-4080-85f9-33f1ef9b9c8a req-f99ebb1b-e0b8-46e0-80b7-045c2798ea22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313fe975-da61-49f7-8aeb-a95dc753e91b", "name": "network-vif-plugged", "status": "completed", "tag": "c14c64c8-333d-4bb0-9882-bbe52bc258dc"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:43.454274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-76a65752-6356-4080-85f9-33f1ef9b9c8a req-f99ebb1b-e0b8-46e0-80b7-045c2798ea22 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:43.454818 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-76a65752-6356-4080-85f9-33f1ef9b9c8a req-f99ebb1b-e0b8-46e0-80b7-045c2798ea22 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:43.467362 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-76a65752-6356-4080-85f9-33f1ef9b9c8a req-f99ebb1b-e0b8-46e0-80b7-045c2798ea22 service nova] Creating event network-vif-plugged:c14c64c8-333d-4bb0-9882-bbe52bc258dc for instance 313fe975-da61-49f7-8aeb-a95dc753e91b on hv-cinder-85057 Jul 26 05:08:43.473659 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-76a65752-6356-4080-85f9-33f1ef9b9c8a req-f99ebb1b-e0b8-46e0-80b7-045c2798ea22 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033920 Jul 26 05:08:43.474390 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 424/826] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:43.678458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-6b80d2b8-d02f-4467-96d9-d658a9b64be2 req-575e2941-6424-4e7c-970f-ef48b9ebaf83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "111ba5fc-f989-4373-b60a-59c603db68c7", "tag": "1062f18d-357b-4737-945e-a6d026c01d69"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:43.690522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6b80d2b8-d02f-4467-96d9-d658a9b64be2 req-575e2941-6424-4e7c-970f-ef48b9ebaf83 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:43.691103 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6b80d2b8-d02f-4467-96d9-d658a9b64be2 req-575e2941-6424-4e7c-970f-ef48b9ebaf83 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:43.712424 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-6b80d2b8-d02f-4467-96d9-d658a9b64be2 req-575e2941-6424-4e7c-970f-ef48b9ebaf83 service nova] Creating event network-changed:1062f18d-357b-4737-945e-a6d026c01d69 for instance 111ba5fc-f989-4373-b60a-59c603db68c7 on hv-cinder-85057 Jul 26 05:08:43.717829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-6b80d2b8-d02f-4467-96d9-d658a9b64be2 req-575e2941-6424-4e7c-970f-ef48b9ebaf83 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051398 Jul 26 05:08:43.718834 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 403/827] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:44.027054 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:44.027789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:44.034194 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:44.034587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:44.035367 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:44.035827 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:44.170801 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:44.179170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fc8d9cd5-59bb-4ac2-9be3-3ee48e9471cf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.156462 Jul 26 05:08:44.183679 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 425/828] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:44 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:45.205714 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:45.206693 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:45.213640 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:45.214092 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:45.214883 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:45.215344 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:45.370790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:45.380933 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1ef4bce1-2232-4685-acc7-4b302acb10da tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1265 microversion: 2.1 time: 0.182263 Jul 26 05:08:45.381516 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 404/829] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:45 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:46.402508 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:46.403151 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:46.410461 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.410894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:46.411677 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.412099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:46.554024 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:46.562560 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6fc7193d-2442-4890-92c8-6e53c7a04662 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1452 microversion: 2.1 time: 0.163928 Jul 26 05:08:46.563116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 426/830] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:46 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:46.589174 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:46.589879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:46.596992 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.597446 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:46.598234 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:46.598671 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:46.743749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:46.753433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5cbdb0cb-9fb2-4657-bd47-eda6964cf191 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1452 microversion: 2.1 time: 0.167820 Jul 26 05:08:46.754138 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 405/831] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:46 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:48.423300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-363f89de-88a9-4b0f-be69-640c2a13f5cb req-8cded152-5fcd-42f4-90a3-1d065a94a49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313fe975-da61-49f7-8aeb-a95dc753e91b", "tag": "c14c64c8-333d-4bb0-9882-bbe52bc258dc"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:48.442400 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-363f89de-88a9-4b0f-be69-640c2a13f5cb req-8cded152-5fcd-42f4-90a3-1d065a94a49b service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:48.442400 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-363f89de-88a9-4b0f-be69-640c2a13f5cb req-8cded152-5fcd-42f4-90a3-1d065a94a49b service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:48.449279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-363f89de-88a9-4b0f-be69-640c2a13f5cb req-8cded152-5fcd-42f4-90a3-1d065a94a49b service nova] Creating event network-changed:c14c64c8-333d-4bb0-9882-bbe52bc258dc for instance 313fe975-da61-49f7-8aeb-a95dc753e91b on hv-cinder-85057 Jul 26 05:08:48.454831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-363f89de-88a9-4b0f-be69-640c2a13f5cb req-8cded152-5fcd-42f4-90a3-1d065a94a49b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035088 Jul 26 05:08:48.455622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 427/832] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:08:57.491085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-77346834-efaf-47bd-9c7f-48839aa5652b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:08:57.493779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-77346834-efaf-47bd-9c7f-48839aa5652b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:57.496617 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=67 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:57.497275 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=89 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:57.503940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77346834-efaf-47bd-9c7f-48839aa5652b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:57.504490 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77346834-efaf-47bd-9c7f-48839aa5652b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:57.505283 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77346834-efaf-47bd-9c7f-48839aa5652b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:57.505718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77346834-efaf-47bd-9c7f-48839aa5652b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:57.580578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-77346834-efaf-47bd-9c7f-48839aa5652b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/action" status: 202 len: 0 microversion: 2.1 time: 0.093385 Jul 26 05:08:57.581256 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 406/833] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:08:57 2022] POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:08:57.592146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:57.597099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:57.599225 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:08:57.605616 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:57.606091 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:57.607061 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:57.607533 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:57.862003 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:57.870614 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a2880e42-2012-4fc5-b0ba-536715a6482e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1752 microversion: 2.1 time: 0.283548 Jul 26 05:08:57.871419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 428/834] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:57 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1752 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:08:58.893546 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:08:58.894273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:08:58.901455 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:58.901893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:58.902655 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:08:58.903085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:08:59.068117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:08:59.076970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-74b6daf9-6aad-4c54-a656-420dcf710cd0 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.187786 Jul 26 05:08:59.077576 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 407/835] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:08:58 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:00.101242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:00.102275 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:00.111613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:00.112241 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:00.113280 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:00.113842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:00.278241 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:00.289665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-aa8f051e-8709-4d05-af90-104fa454904a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.193719 Jul 26 05:09:00.290324 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 429/836] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:00 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:01.312870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:01.313499 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:01.320636 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:01.321109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:01.321874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:01.322338 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:01.474522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:01.483447 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cf6c155a-f22c-4816-8949-ab26d567b9c2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.174564 Jul 26 05:09:01.484064 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 408/837] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:01 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:02.507615 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:02.508464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:02.515288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:02.515769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:02.516539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:02.516970 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:02.684122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:02.695430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ef4a2e66-a2aa-4c80-a909-9a703bbec6e2 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.193199 Jul 26 05:09:02.696081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 430/838] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:02 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:03.717488 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:03.718042 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:03.724992 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:03.725438 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:03.726265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:03.726695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:03.934119 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:03.942563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4a1f0e43-e813-4d8b-9035-050e167d7554 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.229211 Jul 26 05:09:03.943140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 409/839] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:03 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:04.966882 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:04.968206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:04.981014 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:04.981456 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:04.982225 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:04.982652 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:05.160398 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:05.172772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b1b7d4ab-b4e0-4460-b345-36a171e9d271 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.210849 Jul 26 05:09:05.173830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 431/840] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:04 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:06.198282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:06.198876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:06.205943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:06.206390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:06.207142 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:06.207598 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:06.354791 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:06.363450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c3ca358e-21ce-45b6-a219-87e7696b8fd7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.169208 Jul 26 05:09:06.364064 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 410/841] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:06 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:07.386810 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:07.387456 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:07.396673 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:07.397389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:07.398665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:07.399132 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:07.401830 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=77 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:07.576752 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:07.585510 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ff373135-f4e5-4a7e-8453-d761ab895de7 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.202714 Jul 26 05:09:07.586235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 432/842] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:07 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:08.608161 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:08.608718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:08.615755 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:08.616176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.616946 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:08.617629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:08.783444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:08.793958 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3bfc7b7a-488d-468e-8c8d-c9c64a13476b tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.189853 Jul 26 05:09:08.794509 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 411/843] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:08 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:09.817791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:09.818419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:09.826504 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:09.827050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:09.828069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:09.828592 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:09.974731 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:09.983269 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a90ad67f-4a4a-430f-851b-a02ffffde57a tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.170832 Jul 26 05:09:09.983884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 433/844] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:09 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:11.005670 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:11.006412 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:11.013657 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.014099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.014874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:11.015277 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:11.167881 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:11.181112 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-14adb77f-3f92-47d6-9836-b2e1c11c837c tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.179725 Jul 26 05:09:11.182017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 412/845] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:11 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:12.203789 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:12.204406 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:12.211779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:12.212278 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:12.213656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:12.214096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:12.366018 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:12.377987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b3b54d97-ce59-4124-beb5-07b9458cb794 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.177987 Jul 26 05:09:12.378745 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 434/846] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:12 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:13.399949 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:13.400564 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:13.407285 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:13.407767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:13.408536 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:13.408971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:13.572050 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:13.580232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cbfe61fa-1266-4030-bfc3-0886331583f6 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.184474 Jul 26 05:09:13.580814 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 413/847] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:13 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:14.604800 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:14.605590 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:14.612761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:14.613206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:14.613984 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:14.614417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:14.769263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:14.781648 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b38c1d79-6faf-414e-bacd-de55956c4136 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.181888 Jul 26 05:09:14.782578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 435/848] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:14 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:15.807485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:15.808075 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:15.815126 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:15.815602 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:15.816382 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:15.816819 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:15.988770 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:15.996993 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bb94f7e1-7637-4d50-886f-b3185161ab96 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.195993 Jul 26 05:09:15.997543 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 414/849] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:15 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:17.019002 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:17.019610 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:17.025991 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:17.026432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:17.027194 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:17.027649 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:17.184768 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:17.193450 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-886c3929-a926-483a-91c6-be0d034e2019 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.178602 Jul 26 05:09:17.194010 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 436/850] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:17 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:18.221782 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:18.222398 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:18.229319 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:18.229773 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:18.230556 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:18.230989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:18.388032 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:18.396172 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c96f0d27-3f34-41b3-95a6-27788b286e07 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1757 microversion: 2.1 time: 0.178519 Jul 26 05:09:18.396744 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 415/851] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:18 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:19.418748 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:19.419365 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:19.426044 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:19.426495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:19.427235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:19.427705 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:19.589859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:19.598493 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-16835f41-d3e9-4a55-98fb-43ab5a566d24 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1760 microversion: 2.1 time: 0.183718 Jul 26 05:09:19.599111 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 437/852] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:19 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:27.111497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f086cbc-3003-4baf-8aa3-34712863c784 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:27.112141 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9f086cbc-3003-4baf-8aa3-34712863c784 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:27.119039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f086cbc-3003-4baf-8aa3-34712863c784 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.119487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f086cbc-3003-4baf-8aa3-34712863c784 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.120284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f086cbc-3003-4baf-8aa3-34712863c784 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.120706 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f086cbc-3003-4baf-8aa3-34712863c784 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.144473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9f086cbc-3003-4baf-8aa3-34712863c784 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7/ips" status: 200 len: 150 microversion: 2.1 time: 0.036944 Jul 26 05:09:27.145041 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 416/853] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:09:27 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:27.162383 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5025d7a3-2359-4089-a90b-271ffc194be7"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:27.165675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:27.174166 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.174614 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.175370 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.175842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.261609 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Invalid volume: volume 5025d7a3-2359-4089-a90b-271ffc194be7 is already attached to instances: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7/os-volume_attachments HTTP/1.1 Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 74 Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:09:27.263432 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {"volumeAttachment": {"volumeId": "5025d7a3-2359-4089-a90b-271ffc194be7"}} Jul 26 05:09:27.265206 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Invalid volume: volume 5025d7a3-2359-4089-a90b-271ffc194be7 is already attached to instances: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'server_id': '111ba5fc-f989-4373-b60a-59c603db68c7', 'body': {'volumeAttachment': {'volumeId': '5025d7a3-2359-4089-a90b-271ffc194be7'}}} Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5025d7a3-2359-4089-a90b-271ffc194be7 is already attached to instances: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:09:27.266126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5025d7a3-2359-4089-a90b-271ffc194be7 is already attached to instances: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:27.267415 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5025d7a3-2359-4089-a90b-271ffc194be7 is already attached to instances: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 400 to user: Invalid volume: volume 5025d7a3-2359-4089-a90b-271ffc194be7 is already attached to instances: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-29d08965-baeb-46a9-8fa3-5ee9b08d5492 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108978 Jul 26 05:09:27.269038 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 438/854] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:09:27 2022] POST /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:09:27.273667 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:27.274158 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:27.280319 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.280755 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.281501 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.281929 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.306476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:09:27.391409 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f7af491e-929e-49ef-aac2-42a0eaacf9ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 204 len: 0 microversion: 2.1 time: 0.121331 Jul 26 05:09:27.392120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 417/855] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:09:27 2022] DELETE /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:09:27.401213 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:27.401821 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:27.408008 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.408467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.409202 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:27.409627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:27.544583 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:27.556134 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6a058c8d-17f4-47ed-a9fb-6664e60170fd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1682 microversion: 2.1 time: 0.158412 Jul 26 05:09:27.557212 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 439/856] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:27 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:28.578999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:28.579584 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:28.582020 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:28.588288 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:28.588859 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:28.589624 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:28.590058 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:28.593230 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:28.733759 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:28.741485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0ceef875-2fd0-4447-9a99-ecb0fd4b4593 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1682 microversion: 2.1 time: 0.167021 Jul 26 05:09:28.742049 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 418/857] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:28 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:29.769305 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:29.769714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:29.772131 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=24 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:29.777867 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:29.778313 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:29.779358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:29.780015 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:29.819821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-22efa33d-3be5-4b32-ace4-1f91c45665ba req-bfce2c10-79fb-45f2-bfca-df12e4c1373a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "111ba5fc-f989-4373-b60a-59c603db68c7", "name": "network-vif-deleted", "tag": "1062f18d-357b-4737-945e-a6d026c01d69"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:29.832015 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-22efa33d-3be5-4b32-ace4-1f91c45665ba req-bfce2c10-79fb-45f2-bfca-df12e4c1373a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:29.832822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-22efa33d-3be5-4b32-ace4-1f91c45665ba req-bfce2c10-79fb-45f2-bfca-df12e4c1373a service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:29.845879 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-22efa33d-3be5-4b32-ace4-1f91c45665ba req-bfce2c10-79fb-45f2-bfca-df12e4c1373a service nova] Creating event network-vif-deleted:1062f18d-357b-4737-945e-a6d026c01d69 for instance 111ba5fc-f989-4373-b60a-59c603db68c7 on hv-cinder-85057 Jul 26 05:09:29.852013 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-22efa33d-3be5-4b32-ace4-1f91c45665ba req-bfce2c10-79fb-45f2-bfca-df12e4c1373a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036844 Jul 26 05:09:29.853375 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 419/858] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:29.857006 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:29.868802 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-682db24e-818e-443b-b559-4751d60fb59c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 200 len: 1614 microversion: 2.1 time: 0.103297 Jul 26 05:09:29.869650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 440/859] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:29 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:30.891970 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:30.892644 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:30.899389 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:30.899860 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:30.900627 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:30.901047 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:30.914887 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 HTTP/1.1 Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:09:30.916673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:09:30.918416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '111ba5fc-f989-4373-b60a-59c603db68c7'} Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:09:30.919414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:09:30.920894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:30.922265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:09:30.922265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f9485f63-6081-44fb-a3ee-f613a07dcdcd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 404 len: 111 microversion: 2.1 time: 0.031043 Jul 26 05:09:30.922265 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 420/860] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:30 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:09:30.927909 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-974c2e59-7f82-426c-9998-e167dc9dcb8b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '.version_select at 0x7f0e95088160>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:30.952785 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-974c2e59-7f82-426c-9998-e167dc9dcb8b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771264776" status: 202 len: 0 microversion: 2.1 time: 0.029277 Jul 26 05:09:30.953402 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 441/861] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Jul 26 05:09:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771264776 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:09:31.928608 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:31.929193 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:31.936475 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:31.936859 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:31.937638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:31.938119 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:32.027231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lazy-loading 'services' on Instance uuid 4bd266ba-c238-47fc-9ff2-1176d4d46a5b {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:09:32.117606 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-65240664-4563-4fff-be05-68f9b526bf40 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments/5025d7a3-2359-4089-a90b-271ffc194be7" status: 202 len: 0 microversion: 2.1 time: 0.192857 Jul 26 05:09:32.118201 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 421/862] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:09:31 2022] DELETE /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments/5025d7a3-2359-4089-a90b-271ffc194be7 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:09:32.128199 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4034c931-f2ed-4974-93b6-4c313f75ab02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:32.130352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4034c931-f2ed-4974-93b6-4c313f75ab02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:32.138012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4034c931-f2ed-4974-93b6-4c313f75ab02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:32.138658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4034c931-f2ed-4974-93b6-4c313f75ab02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:32.140245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4034c931-f2ed-4974-93b6-4c313f75ab02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:32.140678 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4034c931-f2ed-4974-93b6-4c313f75ab02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:32.173570 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4034c931-f2ed-4974-93b6-4c313f75ab02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050621 Jul 26 05:09:32.174133 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 442/863] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:09:32 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:33.188295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5acc650b-f81f-484c-946a-21ec67e5e5f3 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:33.190950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5acc650b-f81f-484c-946a-21ec67e5e5f3 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:33.198009 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5acc650b-f81f-484c-946a-21ec67e5e5f3 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:33.198449 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5acc650b-f81f-484c-946a-21ec67e5e5f3 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:33.199217 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5acc650b-f81f-484c-946a-21ec67e5e5f3 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:33.199674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5acc650b-f81f-484c-946a-21ec67e5e5f3 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:33.230842 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5acc650b-f81f-484c-946a-21ec67e5e5f3 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047886 Jul 26 05:09:33.231754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 422/864] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:09:33 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:09:33.294703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:33.295245 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:33.302056 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:33.302471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:33.303282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:33.303751 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:33.331044 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:09:33.413968 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-877bcbf9-1349-4a3f-9e9d-6281af6d7a02 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 204 len: 0 microversion: 2.1 time: 0.122878 Jul 26 05:09:33.414471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 443/865] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:09:33 2022] DELETE /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:09:33.424841 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:33.425541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:33.435017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:33.435688 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:33.436761 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:33.437560 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:33.582317 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:33.593248 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4ffaba2c-d41a-4c1e-b966-364c5def0b21 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1680 microversion: 2.1 time: 0.173514 Jul 26 05:09:33.593825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 423/866] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:33 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:34.615836 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:34.616562 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:34.625185 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:34.625812 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:34.627023 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:34.627540 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:34.917722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:34.925576 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-585ec96b-13d2-4c1a-a4f7-54dddcbad367 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1680 microversion: 2.1 time: 0.314267 Jul 26 05:09:34.926144 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 444/867] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:34 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:35.949278 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:35.949901 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:35.957173 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:35.957766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:35.958440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:35.958872 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:36.050283 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:36.058894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d394f275-01d4-4333-b03c-552c0c4812b4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 200 len: 1612 microversion: 2.1 time: 0.114270 Jul 26 05:09:36.059481 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 424/868] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:35 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 1612 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:36.275881 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-1326b9d6-21a4-4cc4-825a-97eb2f419761 req-9c22b18e-c1ce-40bd-8964-57b03e5f2906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bd266ba-c238-47fc-9ff2-1176d4d46a5b", "name": "network-vif-deleted", "tag": "61e555f8-fed5-4569-b13d-5927a204917c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:36.286005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-1326b9d6-21a4-4cc4-825a-97eb2f419761 req-9c22b18e-c1ce-40bd-8964-57b03e5f2906 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:36.286442 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-1326b9d6-21a4-4cc4-825a-97eb2f419761 req-9c22b18e-c1ce-40bd-8964-57b03e5f2906 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:36.298694 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-1326b9d6-21a4-4cc4-825a-97eb2f419761 req-9c22b18e-c1ce-40bd-8964-57b03e5f2906 service nova] Creating event network-vif-deleted:61e555f8-fed5-4569-b13d-5927a204917c for instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b on hv-cinder-85057 Jul 26 05:09:36.304346 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-1326b9d6-21a4-4cc4-825a-97eb2f419761 req-9c22b18e-c1ce-40bd-8964-57b03e5f2906 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031658 Jul 26 05:09:36.304630 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 445/869] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:37.082039 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:37.082639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:37.089980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:37.090349 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:37.091128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:37.091593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:37.106101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b HTTP/1.1 Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:09:37.107863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:09:37.109429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '4bd266ba-c238-47fc-9ff2-1176d4d46a5b'} Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:09:37.110207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:09:37.111779 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:09:37.113187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:09:37.113187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ad6e08fe-e4a8-489c-9540-d77cf9f447e7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 404 len: 111 microversion: 2.1 time: 0.031312 Jul 26 05:09:37.113187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 425/870] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:37 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:09:37.118753 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4ef4ee3c-baed-41e0-8bf2-a2964c409533 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '.version_select at 0x7f0e950cb670>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:37.140878 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4ef4ee3c-baed-41e0-8bf2-a2964c409533 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-950781690" status: 202 len: 0 microversion: 2.1 time: 0.026165 Jul 26 05:09:37.141930 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 446/871] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Jul 26 05:09:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-950781690 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:09:37.823325 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-32f626cd-1f87-494e-b020-b522d5f4a31e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: .version_select at 0x7f0e95075f70>, body: {"keypair": {"name": "tempest-keypair-1337436712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrBrk49/v48DQu+7TCdo+PA45Jx0JZiInLKKC30PkFZAseZPv5FoKH4qvzWblOdr8erxYXqXvY0d4AliE5vojcndrdRJSIrTe4NyQoJh/7umQ6wsk3pEnmOXfhJu5FSuA=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:37.838941 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-32f626cd-1f87-494e-b020-b522d5f4a31e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:09:37.843158 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-32f626cd-1f87-494e-b020-b522d5f4a31e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:09:37.867921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-32f626cd-1f87-494e-b020-b522d5f4a31e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048381 Jul 26 05:09:37.868518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 426/872] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:09:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:39.177664 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1784304876", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "912d8cea-04c4-42a2-bd90-8733248dc6ae"}], "security_groups": [{"name": "tempest-securitygroup--1510117701"}], "key_name": "tempest-keypair-1337436712", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:39.316495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] validate_networks() for [('912d8cea-04c4-42a2-bd90-8733248dc6ae', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:09:39.730904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:09:39.731423 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:09:39.732123 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:09:39.732646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:09:39.733193 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:09:39.746484 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:39.747047 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:39.748268 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:39.748821 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:39.755107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:39.768791 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:09:39.772859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:09:39.784859 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:09:39.787271 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:09:39.835835 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cbccdf2c-c24a-4b69-97d4-8d833d57a42d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663065 Jul 26 05:09:39.836417 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 447/873] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:09:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:09:39.847738 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3556a227-7d72-45ba-b9b1-34f1c0e83f8b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:39.848393 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3556a227-7d72-45ba-b9b1-34f1c0e83f8b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:39.904915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3556a227-7d72-45ba-b9b1-34f1c0e83f8b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:39.912921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3556a227-7d72-45ba-b9b1-34f1c0e83f8b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1242 microversion: 2.1 time: 0.069245 Jul 26 05:09:39.913569 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 427/874] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:39 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:40.935404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:40.936156 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:40.942973 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:40.943399 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:40.944473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:40.945053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:41.014100 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:41.022485 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6d6185be-dfcd-4404-ad86-db39658104c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1302 microversion: 2.1 time: 0.092162 Jul 26 05:09:41.023404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 448/875] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:40 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:42.043983 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:42.044820 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:42.053816 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:42.054327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:42.055119 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:42.055543 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:42.264696 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:42.272975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7d268113-26ac-4172-9cdf-bbbeb7d68c91 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1368 microversion: 2.1 time: 0.233169 Jul 26 05:09:42.273637 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 428/876] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:42 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:42.545500 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-04e913c6-595b-4d80-9425-4f10c9df1e55 req-1c041b3d-2186-45ee-8b2c-3edf05f69483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236b309e-2a0f-4ebf-9d4a-535d718aa7cc", "tag": "6cb768d7-0e58-4829-8644-63135e6f27d4"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:42.559249 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-04e913c6-595b-4d80-9425-4f10c9df1e55 req-1c041b3d-2186-45ee-8b2c-3edf05f69483 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:42.560210 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-04e913c6-595b-4d80-9425-4f10c9df1e55 req-1c041b3d-2186-45ee-8b2c-3edf05f69483 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:42.575084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-04e913c6-595b-4d80-9425-4f10c9df1e55 req-1c041b3d-2186-45ee-8b2c-3edf05f69483 service nova] Creating event network-changed:6cb768d7-0e58-4829-8644-63135e6f27d4 for instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc on hv-cinder-85057 Jul 26 05:09:42.580422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-04e913c6-595b-4d80-9425-4f10c9df1e55 req-1c041b3d-2186-45ee-8b2c-3edf05f69483 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039904 Jul 26 05:09:42.581353 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 449/877] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:43.294384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:43.295000 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:43.301706 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:43.302156 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:43.302963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:43.303396 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:43.437719 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:43.445596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-04f21214-49b0-4261-98da-6184ccc76377 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1368 microversion: 2.1 time: 0.155139 Jul 26 05:09:43.446163 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 429/878] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:43 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:44.467094 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:44.467964 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:44.475159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:44.475596 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:44.476392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:44.476819 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:44.627274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:44.635240 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-705b62cf-6094-44c8-916c-a34dfe6d412f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1368 microversion: 2.1 time: 0.172422 Jul 26 05:09:44.635838 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 450/879] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:44 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:45.659969 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:45.660537 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:45.668989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:45.669439 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:45.670219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:45.670947 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:45.811459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:45.820497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-875a41ab-6cd4-4f94-bf65-7d91746041f6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1368 microversion: 2.1 time: 0.165695 Jul 26 05:09:45.821085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 430/880] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:45 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:46.842244 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:46.842837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:46.849471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:46.849919 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:46.850687 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:46.851121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:46.992981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:47.000802 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2b3a2d86-c9b6-4edb-a5d5-b0793ee64e82 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1368 microversion: 2.1 time: 0.162735 Jul 26 05:09:47.001369 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 451/881] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:46 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:47.782413 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-4c034566-8edf-4ada-800d-b021d2c914d8 req-54ea30f7-fa54-4ee1-87b4-fe5c3ca04d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236b309e-2a0f-4ebf-9d4a-535d718aa7cc", "name": "network-vif-plugged", "status": "completed", "tag": "6cb768d7-0e58-4829-8644-63135e6f27d4"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:47.792907 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-4c034566-8edf-4ada-800d-b021d2c914d8 req-54ea30f7-fa54-4ee1-87b4-fe5c3ca04d20 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:47.793360 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-4c034566-8edf-4ada-800d-b021d2c914d8 req-54ea30f7-fa54-4ee1-87b4-fe5c3ca04d20 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:47.805465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-4c034566-8edf-4ada-800d-b021d2c914d8 req-54ea30f7-fa54-4ee1-87b4-fe5c3ca04d20 service nova] Creating event network-vif-plugged:6cb768d7-0e58-4829-8644-63135e6f27d4 for instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc on hv-cinder-85057 Jul 26 05:09:47.810848 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-4c034566-8edf-4ada-800d-b021d2c914d8 req-54ea30f7-fa54-4ee1-87b4-fe5c3ca04d20 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Jul 26 05:09:47.811482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 431/882] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:48.022069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:48.022625 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:48.029329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:48.029775 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:48.030537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:48.030996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:48.181048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:48.189545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d6518b14-8590-4337-adea-ee43dd6942d4 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1368 microversion: 2.1 time: 0.171525 Jul 26 05:09:48.190114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 452/883] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:48 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:49.215997 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:49.216760 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:49.224189 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:49.224630 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:49.225417 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:49.225842 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:49.372776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:49.380915 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-944ea593-114a-4d9f-b8e1-3d80cea617a2 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1368 microversion: 2.1 time: 0.172647 Jul 26 05:09:49.381512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 432/884] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:49 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:50.402472 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:50.403114 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:50.405553 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:50.406252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:50.412320 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:50.412767 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:50.413556 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:50.413986 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:50.544305 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:09:50.552620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-980f0565-4484-489e-8a22-cd0d6335425b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1558 microversion: 2.1 time: 0.154015 Jul 26 05:09:50.553182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 453/885] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:09:50 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:09:50.573536 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-70a3c883-97a2-4209-8538-7ff48f97ec0e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:09:50.574047 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-70a3c883-97a2-4209-8538-7ff48f97ec0e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:50.575995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:50.582315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70a3c883-97a2-4209-8538-7ff48f97ec0e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:50.582769 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70a3c883-97a2-4209-8538-7ff48f97ec0e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:50.583520 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70a3c883-97a2-4209-8538-7ff48f97ec0e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:50.583977 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-70a3c883-97a2-4209-8538-7ff48f97ec0e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:50.669871 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-70a3c883-97a2-4209-8538-7ff48f97ec0e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099817 Jul 26 05:09:50.670752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 433/886] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:09:50 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:51.892857 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-c8a853e5-9acd-4f31-936b-1f7656ff7a37 req-fbeeaf56-9adb-4c5b-8767-f84fa41c74f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236b309e-2a0f-4ebf-9d4a-535d718aa7cc", "tag": "6cb768d7-0e58-4829-8644-63135e6f27d4"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:51.903260 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-c8a853e5-9acd-4f31-936b-1f7656ff7a37 req-fbeeaf56-9adb-4c5b-8767-f84fa41c74f4 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:51.903730 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-c8a853e5-9acd-4f31-936b-1f7656ff7a37 req-fbeeaf56-9adb-4c5b-8767-f84fa41c74f4 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:51.916620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-c8a853e5-9acd-4f31-936b-1f7656ff7a37 req-fbeeaf56-9adb-4c5b-8767-f84fa41c74f4 service nova] Creating event network-changed:6cb768d7-0e58-4829-8644-63135e6f27d4 for instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc on hv-cinder-85057 Jul 26 05:09:51.922740 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-c8a853e5-9acd-4f31-936b-1f7656ff7a37 req-fbeeaf56-9adb-4c5b-8767-f84fa41c74f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033648 Jul 26 05:09:51.923332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 454/887] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:09:58.843917 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1149990353"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:58.844808 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:09:58.847620 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:58.856603 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:58.857348 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:58.858612 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:58.859339 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:58.862826 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:09:59.076942 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.network.security_group_api [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Removing security group 839a28ae-e766-494c-b5a7-9539507d6d06 from port 3f693448-895a-4f47-a9c7-ede536579f65 Jul 26 05:09:59.428778 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-567807b3-85cb-4551-970f-c027ada0166f tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/action" status: 202 len: 0 microversion: 2.1 time: 0.592580 Jul 26 05:09:59.431980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 434/888] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:09:58 2022] POST /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:09:59.443395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-c543fc3c-d962-42d3-b22b-2f4f38fd3e12 req-6eef35eb-1c20-473c-adf2-601e0bdbb302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd1067-52b6-48ec-bc52-395a0dc3139d", "tag": "3f693448-895a-4f47-a9c7-ede536579f65"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:09:59.454711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-c543fc3c-d962-42d3-b22b-2f4f38fd3e12 req-6eef35eb-1c20-473c-adf2-601e0bdbb302 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:09:59.455515 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-c543fc3c-d962-42d3-b22b-2f4f38fd3e12 req-6eef35eb-1c20-473c-adf2-601e0bdbb302 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:09:59.467771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-c543fc3c-d962-42d3-b22b-2f4f38fd3e12 req-6eef35eb-1c20-473c-adf2-601e0bdbb302 service nova] Creating event network-changed:3f693448-895a-4f47-a9c7-ede536579f65 for instance d5bd1067-52b6-48ec-bc52-395a0dc3139d on hv-cinder-85057 Jul 26 05:09:59.473166 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-c543fc3c-d962-42d3-b22b-2f4f38fd3e12 req-6eef35eb-1c20-473c-adf2-601e0bdbb302 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033549 Jul 26 05:09:59.474070 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 455/889] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:00.791987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:00.792579 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:00.799724 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:00.800139 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:00.800883 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:00.801523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:00.882927 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lazy-loading 'services' on Instance uuid d5bd1067-52b6-48ec-bc52-395a0dc3139d {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:10:00.960005 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-093e5906-09e2-467c-85bb-98c031ee56cc tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments/4aa0a9c6-a635-4f13-8a7c-a1aca049e51b" status: 202 len: 0 microversion: 2.1 time: 0.171864 Jul 26 05:10:00.960601 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 435/890] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:10:00 2022] DELETE /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments/4aa0a9c6-a635-4f13-8a7c-a1aca049e51b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:10:00.969588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4bab5c2c-b7c5-4334-a70a-62a2269e64de tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:00.972611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4bab5c2c-b7c5-4334-a70a-62a2269e64de tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:00.976542 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:00.980757 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bab5c2c-b7c5-4334-a70a-62a2269e64de tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:00.981433 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bab5c2c-b7c5-4334-a70a-62a2269e64de tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:00.982427 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bab5c2c-b7c5-4334-a70a-62a2269e64de tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:00.982864 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4bab5c2c-b7c5-4334-a70a-62a2269e64de tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:01.014267 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4bab5c2c-b7c5-4334-a70a-62a2269e64de tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049020 Jul 26 05:10:01.014820 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 456/891] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:10:00 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:01.489180 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-6dcdd5ee-51a2-4f8a-bec6-72e9d1dc61dc req-6a07c64b-9200-4d6b-8afe-b107a327543b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5bd1067-52b6-48ec-bc52-395a0dc3139d", "tag": "3f693448-895a-4f47-a9c7-ede536579f65"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:01.502152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6dcdd5ee-51a2-4f8a-bec6-72e9d1dc61dc req-6a07c64b-9200-4d6b-8afe-b107a327543b service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:01.502591 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6dcdd5ee-51a2-4f8a-bec6-72e9d1dc61dc req-6a07c64b-9200-4d6b-8afe-b107a327543b service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:01.514719 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-6dcdd5ee-51a2-4f8a-bec6-72e9d1dc61dc req-6a07c64b-9200-4d6b-8afe-b107a327543b service nova] Creating event network-changed:3f693448-895a-4f47-a9c7-ede536579f65 for instance d5bd1067-52b6-48ec-bc52-395a0dc3139d on hv-cinder-85057 Jul 26 05:10:01.520079 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-6dcdd5ee-51a2-4f8a-bec6-72e9d1dc61dc req-6a07c64b-9200-4d6b-8afe-b107a327543b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034918 Jul 26 05:10:01.520668 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 436/892] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:02.027613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3e9f4e1b-94df-4be2-bf4f-1b9b47336b03 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:02.029796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3e9f4e1b-94df-4be2-bf4f-1b9b47336b03 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:02.036795 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e9f4e1b-94df-4be2-bf4f-1b9b47336b03 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:02.037227 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e9f4e1b-94df-4be2-bf4f-1b9b47336b03 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:02.038215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e9f4e1b-94df-4be2-bf4f-1b9b47336b03 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:02.038646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3e9f4e1b-94df-4be2-bf4f-1b9b47336b03 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:02.068391 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3e9f4e1b-94df-4be2-bf4f-1b9b47336b03 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045229 Jul 26 05:10:02.068961 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 457/893] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:10:02 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:10:02.080768 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:02.081324 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:02.088138 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:02.088635 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:02.089689 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:02.090120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:02.165740 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] HTTP exception thrown: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d is not attached to volume 4aa0a9c6-a635-4f13-8a7c-a1aca049e51b Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Request method failure captured: Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments/4aa0a9c6-a635-4f13-8a7c-a1aca049e51b HTTP/1.1 Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aPyPB5hyV5FpVVrMQK5gvNiB4EwUYIJ1RSV0XWrwxJ0QuDE3H-2KW6qURjtnUnjVTWbE4iR_tFkft5AHwiEjGR8jrNv1FCV8SFVUSG6CLNJxfXeaQC_PRIq95ZUn4cxfWxtl9fvpQD4b5X4BPG6hjCPB9RuO5AJNCj--ovY2rTm1o Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: f1b92b49730c4ce7829e7f14b6870b43 Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-TestMinimumBasicScenario-1991843171 Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:10:02.168203 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1b92b49730c4ce7829e7f14b6870b43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1b92b49730c4ce7829e7f14b6870b43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1b92b49730c4ce7829e7f14b6870b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1b92b49730c4ce7829e7f14b6870b43"}]}] Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-TestMinimumBasicScenario-1991843171 Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f1b92b49730c4ce7829e7f14b6870b43 Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1991843171 Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-TestMinimumBasicScenario-1991843171-project Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: c1e8fc3655db4d428bde11a8fc70c0dc Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-TestMinimumBasicScenario-1991843171-project Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:10:02.170007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d is not attached to volume 4aa0a9c6-a635-4f13-8a7c-a1aca049e51b Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'server_id': 'd5bd1067-52b6-48ec-bc52-395a0dc3139d', 'id': '4aa0a9c6-a635-4f13-8a7c-a1aca049e51b'} Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4aa0a9c6-a635-4f13-8a7c-a1aca049e51b. Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:02.170893 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d is not attached to volume 4aa0a9c6-a635-4f13-8a7c-a1aca049e51b Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d is not attached to volume 4aa0a9c6-a635-4f13-8a7c-a1aca049e51b Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:02.172545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Returning 404 to user: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d is not attached to volume 4aa0a9c6-a635-4f13-8a7c-a1aca049e51b {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:02.173795 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-945250d1-632c-4acc-92b7-6ca6ed2fd7c9 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments/4aa0a9c6-a635-4f13-8a7c-a1aca049e51b" status: 404 len: 154 microversion: 2.1 time: 0.093842 Jul 26 05:10:02.173795 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 437/894] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:10:02 2022] DELETE /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d/os-volume_attachments/4aa0a9c6-a635-4f13-8a7c-a1aca049e51b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:03.317724 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:03.318253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:03.324904 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:03.325349 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:03.326123 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:03.326550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:03.351517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:10:03.431201 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-de0bbb14-1c85-468d-a06e-da6020f547eb tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 204 len: 0 microversion: 2.1 time: 0.117169 Jul 26 05:10:03.431812 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 458/895] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:10:03 2022] DELETE /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:10:03.440702 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:03.441331 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:03.447911 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:03.448380 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:03.449126 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:03.449563 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:03.592861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:03.601143 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fe4ba707-9d37-4981-a4a4-1057033e0967 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1555 microversion: 2.1 time: 0.164535 Jul 26 05:10:03.601719 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 438/896] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:03 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:10:04.627671 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:04.628856 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:04.639913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:04.640654 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:04.641907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:04.642623 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:04.845035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:04.853311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-46a1f3a3-fc05-4080-844f-700177803199 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1555 microversion: 2.1 time: 0.232975 Jul 26 05:10:04.853854 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 459/897] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:04 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:05.874562 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:05.875140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:05.882341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:05.882765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:05.883847 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:05.884279 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:06.151135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1e8fc3655db4d428bde11a8fc70c0dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b92b49730c4ce7829e7f14b6870b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:06.159274 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9b4ebcf9-996d-4e25-9927-73e35baeac78 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 200 len: 1555 microversion: 2.1 time: 0.288681 Jul 26 05:10:06.159908 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 439/898] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:05 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:06.333355 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-d6c30885-84ec-4261-ba7b-ab08cf54f69c req-efd8ecb4-9a8c-49dd-8fe9-1557acfd53a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5bd1067-52b6-48ec-bc52-395a0dc3139d", "name": "network-vif-deleted", "tag": "3f693448-895a-4f47-a9c7-ede536579f65"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:06.346470 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d6c30885-84ec-4261-ba7b-ab08cf54f69c req-efd8ecb4-9a8c-49dd-8fe9-1557acfd53a6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:06.346886 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d6c30885-84ec-4261-ba7b-ab08cf54f69c req-efd8ecb4-9a8c-49dd-8fe9-1557acfd53a6 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:06.360648 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-d6c30885-84ec-4261-ba7b-ab08cf54f69c req-efd8ecb4-9a8c-49dd-8fe9-1557acfd53a6 service nova] Creating event network-vif-deleted:3f693448-895a-4f47-a9c7-ede536579f65 for instance d5bd1067-52b6-48ec-bc52-395a0dc3139d on hv-cinder-85057 Jul 26 05:10:06.366578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-d6c30885-84ec-4261-ba7b-ab08cf54f69c req-efd8ecb4-9a8c-49dd-8fe9-1557acfd53a6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037823 Jul 26 05:10:06.367191 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 460/899] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:07.185464 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:07.186434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] [instance: d5bd1067-52b6-48ec-bc52-395a0dc3139d] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:07.195903 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:07.196382 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:07.197277 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:07.197713 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:07.218478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] HTTP exception thrown: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d could not be found. Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Request method failure captured: Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d HTTP/1.1 Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aPyPB5hyV5FpVVrMQK5gvNiB4EwUYIJ1RSV0XWrwxJ0QuDE3H-2KW6qURjtnUnjVTWbE4iR_tFkft5AHwiEjGR8jrNv1FCV8SFVUSG6CLNJxfXeaQC_PRIq95ZUn4cxfWxtl9fvpQD4b5X4BPG6hjCPB9RuO5AJNCj--ovY2rTm1o Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: f1b92b49730c4ce7829e7f14b6870b43 Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-TestMinimumBasicScenario-1991843171 Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:10:07.221101 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f1b92b49730c4ce7829e7f14b6870b43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f1b92b49730c4ce7829e7f14b6870b43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1b92b49730c4ce7829e7f14b6870b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f1b92b49730c4ce7829e7f14b6870b43"}]}] Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-TestMinimumBasicScenario-1991843171 Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f1b92b49730c4ce7829e7f14b6870b43 Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1991843171 Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-TestMinimumBasicScenario-1991843171-project Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: c1e8fc3655db4d428bde11a8fc70c0dc Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-TestMinimumBasicScenario-1991843171-project Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d could not be found. Jul 26 05:10:07.222757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'd5bd1067-52b6-48ec-bc52-395a0dc3139d'} Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d could not be found. Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:07.223727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d could not be found. Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d could not be found. Jul 26 05:10:07.225117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:07.226387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Returning 404 to user: Instance d5bd1067-52b6-48ec-bc52-395a0dc3139d could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:07.226387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-51270c07-b2b7-4bcc-9965-5df765bdbd1e tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d" status: 404 len: 111 microversion: 2.1 time: 0.044763 Jul 26 05:10:07.226387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 440/900] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:07 2022] GET /compute/v2.1/servers/d5bd1067-52b6-48ec-bc52-395a0dc3139d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:07.233326 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9281d54e-aa27-44e3-965c-3099a36f0bc8 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] Calling method '.version_select at 0x7f0e950eb670>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:07.255282 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9281d54e-aa27-44e3-965c-3099a36f0bc8 tempest-TestMinimumBasicScenario-1991843171 tempest-TestMinimumBasicScenario-1991843171-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1120721877" status: 202 len: 0 microversion: 2.1 time: 0.026224 Jul 26 05:10:07.255880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 461/901] 10.222.0.17 () {58 vars in 1272 bytes} [Tue Jul 26 05:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1120721877 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:10:23.935452 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:10:23.936381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Tue Jul 26 05:10:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:10:27.684199 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8f9a76f3-33b9-4e55-86a9-1b1152fc5e62 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:27.684872 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8f9a76f3-33b9-4e55-86a9-1b1152fc5e62 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:27.689135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=13 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:27.690666 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:27.696419 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f9a76f3-33b9-4e55-86a9-1b1152fc5e62 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:27.696868 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f9a76f3-33b9-4e55-86a9-1b1152fc5e62 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:27.697677 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f9a76f3-33b9-4e55-86a9-1b1152fc5e62 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:27.698097 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f9a76f3-33b9-4e55-86a9-1b1152fc5e62 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:27.723488 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8f9a76f3-33b9-4e55-86a9-1b1152fc5e62 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/ips" status: 200 len: 150 microversion: 2.1 time: 0.044524 Jul 26 05:10:27.724103 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 441/902] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:10:27 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:28.115385 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:28.116348 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:28.117401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-ab5de60c-af08-4ec3-a8f0-196d16a2fd1e req-4f4cebcf-8256-44a3-b3ec-6abab4230564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313fe975-da61-49f7-8aeb-a95dc753e91b", "tag": "c14c64c8-333d-4bb0-9882-bbe52bc258dc"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:28.118857 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:28.119513 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:28.127446 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:28.127970 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:28.128799 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:28.129274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:28.130099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-ab5de60c-af08-4ec3-a8f0-196d16a2fd1e req-4f4cebcf-8256-44a3-b3ec-6abab4230564 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:28.130606 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-ab5de60c-af08-4ec3-a8f0-196d16a2fd1e req-4f4cebcf-8256-44a3-b3ec-6abab4230564 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:28.144061 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-ab5de60c-af08-4ec3-a8f0-196d16a2fd1e req-4f4cebcf-8256-44a3-b3ec-6abab4230564 service nova] Creating event network-changed:c14c64c8-333d-4bb0-9882-bbe52bc258dc for instance 313fe975-da61-49f7-8aeb-a95dc753e91b on hv-cinder-85057 Jul 26 05:10:28.149747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-ab5de60c-af08-4ec3-a8f0-196d16a2fd1e req-4f4cebcf-8256-44a3-b3ec-6abab4230564 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036604 Jul 26 05:10:28.150631 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 442/903] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:28.157711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:10:28.260599 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-46625228-3d33-4a48-aa7c-708ae12378d2 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "DELETE /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 204 len: 0 microversion: 2.1 time: 0.149979 Jul 26 05:10:28.261422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 462/904] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:10:28 2022] DELETE /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:10:28.270549 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:28.271258 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:28.277456 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:28.277904 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:28.278672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:28.279126 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:28.419155 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:28.427410 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0461a403-07cc-47ea-af24-16d9def5a1c4 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1577 microversion: 2.1 time: 0.161514 Jul 26 05:10:28.427948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 443/905] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:28 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:10:29.070372 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1f6c225d-f5b3-4ec4-a15e-8695c6293175 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e32321e-2e97-415f-a98f-c172e842040a"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:29.072921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1f6c225d-f5b3-4ec4-a15e-8695c6293175 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:29.079460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6c225d-f5b3-4ec4-a15e-8695c6293175 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:29.079948 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6c225d-f5b3-4ec4-a15e-8695c6293175 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:29.080905 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6c225d-f5b3-4ec4-a15e-8695c6293175 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:29.081338 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1f6c225d-f5b3-4ec4-a15e-8695c6293175 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:29.448730 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:29.449350 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:29.464792 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:29.465245 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:29.466029 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:29.466515 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:29.568250 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1f6c225d-f5b3-4ec4-a15e-8695c6293175 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502356 Jul 26 05:10:29.568926 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 463/906] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:10:29 2022] POST /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:29.639299 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:29.648895 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-650798b9-8487-403d-a309-210c8c80b52f tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1577 microversion: 2.1 time: 0.203671 Jul 26 05:10:29.649434 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 444/907] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:29 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:10:30.670632 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:30.671322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:30.678009 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:30.678687 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:30.679522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:30.679951 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:30.908634 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-ac50e887-721e-4639-a48e-ef93461d55a2 req-d6b58627-492f-4937-bc6a-b116f0bef870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313fe975-da61-49f7-8aeb-a95dc753e91b", "name": "network-vif-deleted", "tag": "c14c64c8-333d-4bb0-9882-bbe52bc258dc"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:30.919346 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-ac50e887-721e-4639-a48e-ef93461d55a2 req-d6b58627-492f-4937-bc6a-b116f0bef870 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:30.919790 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-ac50e887-721e-4639-a48e-ef93461d55a2 req-d6b58627-492f-4937-bc6a-b116f0bef870 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:30.921936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:30.931000 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-75fadaef-7fb6-41ab-bca1-370d73abeb97 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 200 len: 1458 microversion: 2.1 time: 0.264353 Jul 26 05:10:30.931463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-ac50e887-721e-4639-a48e-ef93461d55a2 req-d6b58627-492f-4937-bc6a-b116f0bef870 service nova] Creating event network-vif-deleted:c14c64c8-333d-4bb0-9882-bbe52bc258dc for instance 313fe975-da61-49f7-8aeb-a95dc753e91b on hv-cinder-85057 Jul 26 05:10:30.945525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 464/908] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:30 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 1458 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:30.947857 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-ac50e887-721e-4639-a48e-ef93461d55a2 req-d6b58627-492f-4937-bc6a-b116f0bef870 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042805 Jul 26 05:10:30.948464 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 445/909] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:31.952963 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:31.953525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 313fe975-da61-49f7-8aeb-a95dc753e91b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:31.960320 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:31.960763 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:31.961519 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:31.961975 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:31.977674 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] HTTP exception thrown: Instance 313fe975-da61-49f7-8aeb-a95dc753e91b could not be found. Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Request method failure captured: Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b HTTP/1.1 Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33WJu-x6GbbTOxz9RIKRgTQ1jfnwmI1AcQhrBDRXGGKN7Alj0kqvw3xINUIv1SrND2Qt2qsW_yK6fzl8RNL4L8x28NBLPq2liGbmas_2v4WnLHVRrGlC614O_TX5_zIqFolkCd1g472FaUq67nZkDDyGKdhKN4oemxxaPB_agPUcU7k Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:10:31.979309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/987757bb89e64419822e021b15a65c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_987757bb89e64419822e021b15a65c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}] Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 148ea5a9b7a74172b290696be99aa5c1 Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 313fe975-da61-49f7-8aeb-a95dc753e91b could not be found. Jul 26 05:10:31.981019 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '313fe975-da61-49f7-8aeb-a95dc753e91b'} Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 313fe975-da61-49f7-8aeb-a95dc753e91b could not be found. Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:31.982080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 313fe975-da61-49f7-8aeb-a95dc753e91b could not be found. Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 313fe975-da61-49f7-8aeb-a95dc753e91b could not be found. Jul 26 05:10:31.986410 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:31.987982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Returning 404 to user: Instance 313fe975-da61-49f7-8aeb-a95dc753e91b could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:31.987982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-14aaa9cc-67dc-4fab-bcbb-7a35adceeab8 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b" status: 404 len: 111 microversion: 2.1 time: 0.031890 Jul 26 05:10:31.987982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 465/910] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:31 2022] GET /compute/v2.1/servers/313fe975-da61-49f7-8aeb-a95dc753e91b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:35.129341 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:35.129918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:35.134441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-08e30982-d0db-417f-bdeb-31acea5c1c22 req-9e8175df-fc56-48f0-8ff8-7a293eda78de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048e3ed2-61f1-4d21-92c7-cfd8a94abb52", "tag": "74e6a160-dc8d-420e-9018-7b77f693900b"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:35.143216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:35.143679 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:35.144657 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:35.145295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:35.145507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-08e30982-d0db-417f-bdeb-31acea5c1c22 req-9e8175df-fc56-48f0-8ff8-7a293eda78de service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:35.145959 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-08e30982-d0db-417f-bdeb-31acea5c1c22 req-9e8175df-fc56-48f0-8ff8-7a293eda78de service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:35.157675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-08e30982-d0db-417f-bdeb-31acea5c1c22 req-9e8175df-fc56-48f0-8ff8-7a293eda78de service nova] Creating event network-changed:74e6a160-dc8d-420e-9018-7b77f693900b for instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 on hv-cinder-85057 Jul 26 05:10:35.163244 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-08e30982-d0db-417f-bdeb-31acea5c1c22 req-9e8175df-fc56-48f0-8ff8-7a293eda78de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036281 Jul 26 05:10:35.164361 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 466/911] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:10:35.181557 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:10:35.291053 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-726b82c5-4388-4da6-b558-1f2c1a95835a tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "DELETE /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 204 len: 0 microversion: 2.1 time: 0.163145 Jul 26 05:10:35.291807 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 446/912] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:10:35 2022] DELETE /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:10:35.300529 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:35.301389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:35.308762 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:35.309209 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:35.309990 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:35.310430 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:35.475970 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:35.484125 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5a28b19a-32fa-4815-910e-275352a8a814 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1577 microversion: 2.1 time: 0.187840 Jul 26 05:10:35.484696 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 467/913] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:35 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:36.511008 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:36.512215 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:36.523380 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:36.524194 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:36.525461 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:36.526183 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:36.703242 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:36.711469 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ff53a48d-db67-4cb9-b416-5321f938d14c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1577 microversion: 2.1 time: 0.207842 Jul 26 05:10:36.712086 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 447/914] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:36 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:37.733588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:37.734163 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:37.740898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:37.741332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:37.742161 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:37.742586 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.012117 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:38.019988 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ed6a486c-e146-4de0-a5a2-9c7c272d9523 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1577 microversion: 2.1 time: 0.290358 Jul 26 05:10:38.020534 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 468/915] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:37 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1577 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:38.213402 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-2104cc11-5770-4836-984d-e0f4f4e8c480 req-b28dcece-cb7b-46ef-83a4-060949032c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048e3ed2-61f1-4d21-92c7-cfd8a94abb52", "name": "network-vif-deleted", "tag": "74e6a160-dc8d-420e-9018-7b77f693900b"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:38.216379 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e32321e-2e97-415f-a98f-c172e842040a"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:38.218869 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:38.224878 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2104cc11-5770-4836-984d-e0f4f4e8c480 req-b28dcece-cb7b-46ef-83a4-060949032c31 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:38.225191 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:38.225381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2104cc11-5770-4836-984d-e0f4f4e8c480 req-b28dcece-cb7b-46ef-83a4-060949032c31 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.225983 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.226923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:38.227517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.240995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-2104cc11-5770-4836-984d-e0f4f4e8c480 req-b28dcece-cb7b-46ef-83a4-060949032c31 service nova] Creating event network-vif-deleted:74e6a160-dc8d-420e-9018-7b77f693900b for instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 on hv-cinder-85057 Jul 26 05:10:38.248891 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-2104cc11-5770-4836-984d-e0f4f4e8c480 req-b28dcece-cb7b-46ef-83a4-060949032c31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041478 Jul 26 05:10:38.249657 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 448/916] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:38.314436 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Invalid volume: volume 7e32321e-2e97-415f-a98f-c172e842040a is already attached to instances: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: POST /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments HTTP/1.1 Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 74 Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:10:38.316292 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {"volumeAttachment": {"volumeId": "7e32321e-2e97-415f-a98f-c172e842040a"}} Jul 26 05:10:38.318079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Invalid volume: volume 7e32321e-2e97-415f-a98f-c172e842040a is already attached to instances: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'server_id': '236b309e-2a0f-4ebf-9d4a-535d718aa7cc', 'body': {'volumeAttachment': {'volumeId': '7e32321e-2e97-415f-a98f-c172e842040a'}}} Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e32321e-2e97-415f-a98f-c172e842040a is already attached to instances: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:38.319159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e32321e-2e97-415f-a98f-c172e842040a is already attached to instances: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:38.320650 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e32321e-2e97-415f-a98f-c172e842040a is already attached to instances: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 400 to user: Invalid volume: volume 7e32321e-2e97-415f-a98f-c172e842040a is already attached to instances: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-360c7748-d770-469c-a45c-701bc7e49820 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105526 Jul 26 05:10:38.322261 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 469/917] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:10:38 2022] POST /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 05:10:38.383700 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:38.384413 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:38.390930 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:38.391237 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.392015 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:38.392440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.478675 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lazy-loading 'services' on Instance uuid 236b309e-2a0f-4ebf-9d4a-535d718aa7cc {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:10:38.556360 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-89f47cd3-f83c-4c88-af27-042e667842bb tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments/7e32321e-2e97-415f-a98f-c172e842040a" status: 202 len: 0 microversion: 2.1 time: 0.176911 Jul 26 05:10:38.557206 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 449/918] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:10:38 2022] DELETE /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments/7e32321e-2e97-415f-a98f-c172e842040a => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:10:38.567034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6438413b-049f-479c-b0a3-51f30f3f81c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:38.569374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6438413b-049f-479c-b0a3-51f30f3f81c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:38.580736 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6438413b-049f-479c-b0a3-51f30f3f81c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:38.581180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6438413b-049f-479c-b0a3-51f30f3f81c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.581971 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6438413b-049f-479c-b0a3-51f30f3f81c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:38.582403 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6438413b-049f-479c-b0a3-51f30f3f81c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:38.615609 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6438413b-049f-479c-b0a3-51f30f3f81c7 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052525 Jul 26 05:10:38.616198 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 470/919] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:10:38 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:39.047655 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:39.048722 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:39.059028 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.059473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.060282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.060718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.091754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.092208 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.092654 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lazy-loading 'fault' on Instance uuid 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:10:39.149376 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '148ea5a9b7a74172b290696be99aa5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987757bb89e64419822e021b15a65c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:39.158864 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-74c067d9-c188-4290-be1b-fe0e0f358cc3 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 200 len: 1230 microversion: 2.1 time: 0.118615 Jul 26 05:10:39.159443 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 450/920] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:39 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:39.628732 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4516e672-36b6-438d-ab34-836681fc903a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:39.630880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4516e672-36b6-438d-ab34-836681fc903a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:39.638429 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4516e672-36b6-438d-ab34-836681fc903a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.638879 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4516e672-36b6-438d-ab34-836681fc903a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.639898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4516e672-36b6-438d-ab34-836681fc903a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.640271 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4516e672-36b6-438d-ab34-836681fc903a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.669314 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4516e672-36b6-438d-ab34-836681fc903a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044750 Jul 26 05:10:39.669847 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 471/921] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:10:39 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:10:39.731220 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:39.731777 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:39.738451 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.738884 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.739685 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.740116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.764981 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:10:39.855431 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-552614ec-c76e-4289-8eeb-857e15261b3e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 204 len: 0 microversion: 2.1 time: 0.127947 Jul 26 05:10:39.856181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 451/922] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:10:39 2022] DELETE /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:10:39.865902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:39.866521 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:39.872842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.873322 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:39.874087 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:39.874525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:40.006216 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:40.014851 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-39cca0ee-4cd8-4cdc-bce0-37ab3e845d47 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1683 microversion: 2.1 time: 0.153885 Jul 26 05:10:40.015419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 472/923] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:39 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:40.186078 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:40.187224 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: 048e3ed2-61f1-4d21-92c7-cfd8a94abb52] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:40.198070 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:40.198599 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:40.199284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:40.199767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:40.213960 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] HTTP exception thrown: Instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 could not be found. Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Request method failure captured: Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 HTTP/1.1 Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33WJu-x6GbbTOxz9RIKRgTQ1jfnwmI1AcQhrBDRXGGKN7Alj0kqvw3xINUIv1SrND2Qt2qsW_yK6fzl8RNL4L8x28NBLPq2liGbmas_2v4WnLHVRrGlC614O_TX5_zIqFolkCd1g472FaUq67nZkDDyGKdhKN4oemxxaPB_agPUcU7k Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:10:40.215593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/987757bb89e64419822e021b15a65c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_987757bb89e64419822e021b15a65c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}] Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 148ea5a9b7a74172b290696be99aa5c1 Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 could not be found. Jul 26 05:10:40.217152 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '048e3ed2-61f1-4d21-92c7-cfd8a94abb52'} Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 could not be found. Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:40.218137 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 could not be found. Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 could not be found. Jul 26 05:10:40.219691 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.221176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Returning 404 to user: Instance 048e3ed2-61f1-4d21-92c7-cfd8a94abb52 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:40.221176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8cc02c20-c672-4810-b4e2-7b3e40c05d7c tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52" status: 404 len: 111 microversion: 2.1 time: 0.038439 Jul 26 05:10:40.221176 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 452/924] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:40 2022] GET /compute/v2.1/servers/048e3ed2-61f1-4d21-92c7-cfd8a94abb52 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:40.683071 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:40.683966 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:40.691015 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:40.691463 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:40.692284 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:40.692701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:40.706832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] HTTP exception thrown: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Request method failure captured: Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a HTTP/1.1 Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33WJu-x6GbbTOxz9RIKRgTQ1jfnwmI1AcQhrBDRXGGKN7Alj0kqvw3xINUIv1SrND2Qt2qsW_yK6fzl8RNL4L8x28NBLPq2liGbmas_2v4WnLHVRrGlC614O_TX5_zIqFolkCd1g472FaUq67nZkDDyGKdhKN4oemxxaPB_agPUcU7k Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:10:40.708389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/987757bb89e64419822e021b15a65c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_987757bb89e64419822e021b15a65c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}] Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 148ea5a9b7a74172b290696be99aa5c1 Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.709923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'd72962b6-f3c4-41b4-96fd-5045b03faf2a'} Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:40.710837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.712300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.714090 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Returning 404 to user: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:40.714090 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-d638fd8b-d212-452c-bdc7-e3ac56e26969 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 404 len: 111 microversion: 2.1 time: 0.031926 Jul 26 05:10:40.714090 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 473/925] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:10:40 2022] DELETE /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:40.718695 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:40.719308 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] [instance: d72962b6-f3c4-41b4-96fd-5045b03faf2a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:40.725777 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:40.726230 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:40.726997 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:40.727433 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:40.741762 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] HTTP exception thrown: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Request method failure captured: Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a HTTP/1.1 Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33WJu-x6GbbTOxz9RIKRgTQ1jfnwmI1AcQhrBDRXGGKN7Alj0kqvw3xINUIv1SrND2Qt2qsW_yK6fzl8RNL4L8x28NBLPq2liGbmas_2v4WnLHVRrGlC614O_TX5_zIqFolkCd1g472FaUq67nZkDDyGKdhKN4oemxxaPB_agPUcU7k Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:10:40.743302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/987757bb89e64419822e021b15a65c31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_987757bb89e64419822e021b15a65c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/987757bb89e64419822e021b15a65c31"}]}] Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 987757bb89e64419822e021b15a65c31 Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-TestVolumeBootPattern-506650767 Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 148ea5a9b7a74172b290696be99aa5c1 Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-TestVolumeBootPattern-506650767-project Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.744963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'd72962b6-f3c4-41b4-96fd-5045b03faf2a'} Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:40.745870 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. Jul 26 05:10:40.747120 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:10:40.748295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Returning 404 to user: Instance d72962b6-f3c4-41b4-96fd-5045b03faf2a could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:40.748295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c53d67a9-2b43-4168-a91b-85aa706bc1bf tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a" status: 404 len: 111 microversion: 2.1 time: 0.029966 Jul 26 05:10:40.748295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 453/926] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:40 2022] GET /compute/v2.1/servers/d72962b6-f3c4-41b4-96fd-5045b03faf2a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:41.038130 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:41.038831 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:41.046416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:41.046949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:41.048109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:41.048664 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:41.192283 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:41.200981 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b71b6217-f808-4610-8d4a-2436063c928c tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1683 microversion: 2.1 time: 0.167854 Jul 26 05:10:41.201541 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 474/927] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:41 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:42.054491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b30f6635-87a3-4a98-a942-d3dab7915931 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] Calling method '.version_select at 0x7f0e9505ec10>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:42.116867 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b30f6635-87a3-4a98-a942-d3dab7915931 tempest-TestVolumeBootPattern-506650767 tempest-TestVolumeBootPattern-506650767-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-650642350" status: 202 len: 0 microversion: 2.1 time: 0.070737 Jul 26 05:10:42.120794 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 454/928] 10.222.0.17 () {58 vars in 1260 bytes} [Tue Jul 26 05:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-650642350 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:10:42.222377 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:42.223579 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:42.230837 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:42.232315 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:42.233287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:42.233932 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:42.329164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:42.339204 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-077b355b-de2f-452f-823e-27ba0daae225 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 200 len: 1615 microversion: 2.1 time: 0.120680 Jul 26 05:10:42.339846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 475/929] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:42 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 1615 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:42.425237 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-dca67968-abdf-4ebb-a7a4-4304a7563c74 req-adc3137e-e27e-47d7-b6d5-633904d3daca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236b309e-2a0f-4ebf-9d4a-535d718aa7cc", "name": "network-vif-deleted", "tag": "6cb768d7-0e58-4829-8644-63135e6f27d4"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:42.441903 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-dca67968-abdf-4ebb-a7a4-4304a7563c74 req-adc3137e-e27e-47d7-b6d5-633904d3daca service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:42.442340 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-dca67968-abdf-4ebb-a7a4-4304a7563c74 req-adc3137e-e27e-47d7-b6d5-633904d3daca service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:42.456954 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-dca67968-abdf-4ebb-a7a4-4304a7563c74 req-adc3137e-e27e-47d7-b6d5-633904d3daca service nova] Creating event network-vif-deleted:6cb768d7-0e58-4829-8644-63135e6f27d4 for instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc on hv-cinder-85057 Jul 26 05:10:42.462322 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-dca67968-abdf-4ebb-a7a4-4304a7563c74 req-adc3137e-e27e-47d7-b6d5-633904d3daca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040900 Jul 26 05:10:42.462929 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 455/930] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:42.760441 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:42.761072 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:42.767326 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:42.767876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:42.768642 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:42.769077 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:42.792380 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lazy-loading 'flavor' on Instance uuid 12542af7-79b9-4279-ae59-c5ea7941522f {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:10:42.821350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:42.872860 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-793b3a0a-b663-4266-87b4-1c4e99f1c198 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "POST /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f/action" status: 202 len: 0 microversion: 2.1 time: 0.116168 Jul 26 05:10:42.874136 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 476/931] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:10:42 2022] POST /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:10:42.892065 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:42.893099 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:42.905168 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:42.906021 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:42.906834 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:42.907430 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:43.070756 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:43.081221 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-808bbef3-98fe-4059-a7a7-a04778eb990a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.202227 Jul 26 05:10:43.096558 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 456/932] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:42 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:43.362077 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:43.363743 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:43.370467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:43.371079 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:43.371887 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:43.372318 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:43.392941 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc HTTP/1.1 Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:10:43.394771 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:10:43.396219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '236b309e-2a0f-4ebf-9d4a-535d718aa7cc'} Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:10:43.397081 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:10:43.398316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:10:43.399460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:10:43.399460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-63ddae6c-48b7-44d8-b105-f8ebb462f33b tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 404 len: 111 microversion: 2.1 time: 0.039205 Jul 26 05:10:43.399460 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 477/933] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:43 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:10:43.406457 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-949418a4-0979-4dd2-9b3a-98b8e9f6fd0f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '.version_select at 0x7f0e950b1d30>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:43.430115 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-949418a4-0979-4dd2-9b3a-98b8e9f6fd0f tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337436712" status: 202 len: 0 microversion: 2.1 time: 0.028137 Jul 26 05:10:43.430801 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 457/934] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Jul 26 05:10:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337436712 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:10:44.103265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:44.103265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:44.109876 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:44.110509 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:44.111376 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:44.111817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:44.131195 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b1923f2c-259b-4ec9-b51f-2babec1c5339 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: .version_select at 0x7f0e9515cca0>, body: {"keypair": {"name": "tempest-keypair-1406220077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWnrs6EypDJENiaQG9goirm98Hpq0cvl1fXKhWFQT4poNIjZ2K3mWrYNlOYdnrtCk/5E0zUbb2eQukdEIFGVyzbZrMbdYRNH8s26F5jAANIO/l4dS8hROHPPhCDVCgQLw=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:44.148485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-b1923f2c-259b-4ec9-b51f-2babec1c5339 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:10:44.152524 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-b1923f2c-259b-4ec9-b51f-2babec1c5339 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:10:44.176690 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b1923f2c-259b-4ec9-b51f-2babec1c5339 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049804 Jul 26 05:10:44.177759 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 458/935] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Jul 26 05:10:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:10:44.263605 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:44.274933 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4b6ef63f-bd5d-4897-bafb-bb69edc80ac8 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.176304 Jul 26 05:10:44.275508 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 478/936] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:44 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:45.297669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:45.298287 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:45.304673 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:45.305679 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:45.306459 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:45.306897 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:45.517971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:45.535094 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e0a551a3-b8dc-48ef-b11d-a3f833e7ad92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.242000 Jul 26 05:10:45.535924 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 459/937] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:45 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:45.961034 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1167132142", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "912d8cea-04c4-42a2-bd90-8733248dc6ae"}], "security_groups": [{"name": "tempest-securitygroup--1428862256"}], "key_name": "tempest-keypair-1406220077", "user_data": "}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:46.131540 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] validate_networks() for [('912d8cea-04c4-42a2-bd90-8733248dc6ae', None, None, None, None, None)] {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:10:46.558863 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:46.559416 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:46.566490 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:46.566936 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:46.567767 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:46.568358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:46.587102 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:46.884142 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:46.892336 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dc33f066-e5c9-4140-8620-8fe344e20265 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.338048 Jul 26 05:10:46.893005 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 460/938] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:46 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:47.167755 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:10:47.168242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:10:47.168656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:10:47.169059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:10:47.169463 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:10:47.178995 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:47.179438 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:47.180265 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:47.180692 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:47.201684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:10:47.207614 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Getting quotas for user 92b9d212b86348c6b51a6b02818a0e80 and project fd4481cb5d2f43c5b60db983132a3e16. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:10:47.220947 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:10:47.223258 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:10:47.274918 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0ff4d164-5644-4bfa-802d-35984c6cbe10 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.321265 Jul 26 05:10:47.278832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 479/939] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:10:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:10:47.287382 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-45292a8f-9ce9-4593-a74d-e683b4cad711 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:47.288282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-45292a8f-9ce9-4593-a74d-e683b4cad711 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:47.357405 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-45292a8f-9ce9-4593-a74d-e683b4cad711 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:47.366494 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-45292a8f-9ce9-4593-a74d-e683b4cad711 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1242 microversion: 2.1 time: 0.083494 Jul 26 05:10:47.367088 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 461/940] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:47 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:10:47.913964 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:47.914570 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:47.923330 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:47.923728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:47.924502 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:47.924932 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:48.115569 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:48.123425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-984104ed-9936-4c23-9f9b-2870938e6b98 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.213459 Jul 26 05:10:48.124036 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 480/941] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:47 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:48.388826 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:48.390108 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:48.397922 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:48.398365 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:48.399135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:48.399573 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:48.496629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:48.506692 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7d81e2fd-604b-4639-9635-5f1cfa065ec1 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1302 microversion: 2.1 time: 0.122294 Jul 26 05:10:48.508423 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 462/942] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:48 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:49.145070 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:49.146486 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:49.154873 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:49.155286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:49.156093 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:49.156723 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:49.507703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:49.518545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-368405d0-6b33-4f82-9a2b-14eb6fe3f382 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.377503 Jul 26 05:10:49.520356 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 481/943] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:49 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:49.529354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:49.529997 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:49.537188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:49.537484 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:49.538597 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:49.539072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:49.860718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:49.871829 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0972f191-b926-4cea-9c2d-759ce7aef441 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1368 microversion: 2.1 time: 0.346658 Jul 26 05:10:49.872424 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 463/944] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:49 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1368 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:50.542429 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:50.543033 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:50.549804 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:50.550512 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:50.551368 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:50.551901 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:50.864302 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:50.872251 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8e5f7af3-b6aa-4d3b-bc68-52e89d6ee59e tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.334100 Jul 26 05:10:50.872804 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 482/945] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:50 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:50.892681 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:50.893403 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:50.900125 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:50.900553 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:50.901315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:50.901764 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:51.213441 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:51.221172 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a247139b-6dfe-4a9b-b04f-75b6f13d2565 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1368 microversion: 2.1 time: 0.332341 Jul 26 05:10:51.231822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 464/946] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:50 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:51.344581 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-f3ffdaaa-5e2f-4ffe-8e3e-eb486d2bea4e req-7858e198-d47b-4da9-a96d-fe6a601d7f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e05138-30c8-48ed-9242-b038dda6754e", "tag": "89a362ec-f588-4c14-a9ae-fb9f4e9f3b40"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:51.357787 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-f3ffdaaa-5e2f-4ffe-8e3e-eb486d2bea4e req-7858e198-d47b-4da9-a96d-fe6a601d7f72 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:51.358509 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-f3ffdaaa-5e2f-4ffe-8e3e-eb486d2bea4e req-7858e198-d47b-4da9-a96d-fe6a601d7f72 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:51.371379 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-f3ffdaaa-5e2f-4ffe-8e3e-eb486d2bea4e req-7858e198-d47b-4da9-a96d-fe6a601d7f72 service nova] Creating event network-changed:89a362ec-f588-4c14-a9ae-fb9f4e9f3b40 for instance f3e05138-30c8-48ed-9242-b038dda6754e on hv-cinder-85057 Jul 26 05:10:51.377393 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-f3ffdaaa-5e2f-4ffe-8e3e-eb486d2bea4e req-7858e198-d47b-4da9-a96d-fe6a601d7f72 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036518 Jul 26 05:10:51.382317 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 483/947] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:51.893512 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:51.894117 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:51.900363 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:51.900800 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:51.901623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:51.902055 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:52.042757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:52.050709 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9a1a9a3a-ed45-45e3-9a72-a736499208bb tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.161016 Jul 26 05:10:52.051369 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 465/948] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:51 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:52.243849 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:52.244416 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:52.252046 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:52.252497 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:52.253297 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:52.253735 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:52.404095 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:52.412501 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1b28c014-bdae-43c5-af36-19a8180272cf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1368 microversion: 2.1 time: 0.173487 Jul 26 05:10:52.413243 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 484/949] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:52 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:53.073276 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:53.074275 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:53.082517 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:53.083030 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:53.084127 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:53.084752 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:53.251584 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:53.259502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9dc2f56e-e597-4bcc-a51e-386169a97a55 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.190461 Jul 26 05:10:53.260087 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 466/950] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:53 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:53.434360 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:53.434936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:53.442063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:53.442520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:53.443271 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:53.443746 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:53.656124 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:53.664347 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5ff3ece8-7f02-418a-a874-10daeee6396a tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1368 microversion: 2.1 time: 0.234138 Jul 26 05:10:53.664829 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 485/951] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:53 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:54.281135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:54.281718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:54.288920 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:54.289380 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:54.290414 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:54.290848 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:54.425895 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:54.436757 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c5d4ebfc-b63c-4ae1-9f94-56d495c3f6ac tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.159464 Jul 26 05:10:54.437426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 467/952] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:54 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:54.690473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:54.691966 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:54.704672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:54.705402 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:54.706648 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:54.707362 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:54.846545 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:54.854843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cd97cceb-4934-4fb8-98a1-c5926853b4ae tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1368 microversion: 2.1 time: 0.171358 Jul 26 05:10:54.855470 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 486/953] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:54 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:55.459985 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:55.460607 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:55.468147 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:55.468625 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:55.469398 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:55.469860 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:55.611322 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:55.619250 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d6d510cd-aa45-45bd-b2d6-edd9dd048d6a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.163923 Jul 26 05:10:55.619887 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 468/954] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:55 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:55.878341 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:55.879208 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:55.888130 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:55.888574 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:55.889332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:55.889770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:56.026956 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:56.036115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-32f93ba7-fcff-41a6-9960-0aa7737a5e29 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1368 microversion: 2.1 time: 0.163382 Jul 26 05:10:56.036663 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 487/955] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:55 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:56.253552 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-910180be-ade4-4565-8d1f-64385d52595c req-c81873ff-92f8-4900-8c1f-3f46e62158ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e05138-30c8-48ed-9242-b038dda6754e", "name": "network-vif-plugged", "status": "completed", "tag": "89a362ec-f588-4c14-a9ae-fb9f4e9f3b40"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:56.264482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-910180be-ade4-4565-8d1f-64385d52595c req-c81873ff-92f8-4900-8c1f-3f46e62158ef service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:56.264923 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-910180be-ade4-4565-8d1f-64385d52595c req-c81873ff-92f8-4900-8c1f-3f46e62158ef service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:56.278955 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-910180be-ade4-4565-8d1f-64385d52595c req-c81873ff-92f8-4900-8c1f-3f46e62158ef service nova] Creating event network-vif-plugged:89a362ec-f588-4c14-a9ae-fb9f4e9f3b40 for instance f3e05138-30c8-48ed-9242-b038dda6754e on hv-cinder-85057 Jul 26 05:10:56.283977 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-910180be-ade4-4565-8d1f-64385d52595c req-c81873ff-92f8-4900-8c1f-3f46e62158ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034324 Jul 26 05:10:56.284572 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 469/956] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:10:56.646197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:56.647092 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:56.657272 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:56.658023 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:56.659286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:56.660159 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:56.801668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:56.810115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-41acd0ec-a1d7-4dad-9de9-405cf09a7f41 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1509 microversion: 2.1 time: 0.170535 Jul 26 05:10:56.810668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 488/957] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:56 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:56.831507 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8212a1a9-b019-4188-99a7-608c3666c24b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:56.832205 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8212a1a9-b019-4188-99a7-608c3666c24b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:56.838636 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8212a1a9-b019-4188-99a7-608c3666c24b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:56.839076 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8212a1a9-b019-4188-99a7-608c3666c24b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:56.840015 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8212a1a9-b019-4188-99a7-608c3666c24b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:56.840451 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8212a1a9-b019-4188-99a7-608c3666c24b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:56.919602 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8212a1a9-b019-4188-99a7-608c3666c24b tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "POST /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f/action" status: 202 len: 0 microversion: 2.1 time: 0.092785 Jul 26 05:10:56.920128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 470/958] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Jul 26 05:10:56 2022] POST /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:10:56.928520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:56.929189 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:56.936016 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:56.936467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:56.937224 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:56.937648 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:57.062747 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:57.063356 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:57.069562 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:57.070016 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:57.070788 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:57.071224 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:57.075311 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:57.083059 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-06852efd-fc4e-419c-b6a5-9a5bb1f787fd tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1517 microversion: 2.1 time: 0.158417 Jul 26 05:10:57.083963 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 489/959] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:56 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:10:57.211855 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:57.219912 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e2e3589a-067f-4045-81e4-5edef8f4a307 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1368 microversion: 2.1 time: 0.161517 Jul 26 05:10:57.220491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 471/960] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:57 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:10:58.106977 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:58.107582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:58.109583 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:58.110230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:58.117053 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:58.117490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:58.118260 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:58.118688 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:58.242452 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:58.243065 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:58.245181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:58.246455 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:58.252587 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:58.253071 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:58.253864 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:58.254309 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:58.268061 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:58.275991 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-193e7021-6739-4d77-b031-144fcec89070 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1519 microversion: 2.1 time: 0.175057 Jul 26 05:10:58.276636 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 490/961] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:58 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:58.391066 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:58.399399 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c48244ef-2349-45fc-8fca-9036670fec92 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1558 microversion: 2.1 time: 0.160891 Jul 26 05:10:58.400017 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 472/962] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:58 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:58.420404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7149a550-418e-48c7-898f-7f50677be56e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:58.420896 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7149a550-418e-48c7-898f-7f50677be56e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:58.422751 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:10:58.428483 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7149a550-418e-48c7-898f-7f50677be56e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:58.428923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7149a550-418e-48c7-898f-7f50677be56e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:58.429686 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7149a550-418e-48c7-898f-7f50677be56e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:58.430116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7149a550-418e-48c7-898f-7f50677be56e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:58.510383 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7149a550-418e-48c7-898f-7f50677be56e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093946 Jul 26 05:10:58.511040 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 491/963] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Jul 26 05:10:58 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:10:59.297075 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:10:59.297793 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:10:59.304992 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:59.305527 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:59.306316 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:59.306751 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:59.534052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:10:59.541966 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c652ed36-0804-46d8-a280-0e0b3987cdf6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1575 microversion: 2.1 time: 0.248797 Jul 26 05:10:59.542473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 473/964] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:10:59 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:10:59.704307 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-a7bd3bd8-8185-42f1-935e-c1b401e230f0 req-61d2b52e-a228-435d-8dc6-aedb5249f4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e05138-30c8-48ed-9242-b038dda6754e", "tag": "89a362ec-f588-4c14-a9ae-fb9f4e9f3b40"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:10:59.714660 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a7bd3bd8-8185-42f1-935e-c1b401e230f0 req-61d2b52e-a228-435d-8dc6-aedb5249f4df service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:10:59.715084 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-a7bd3bd8-8185-42f1-935e-c1b401e230f0 req-61d2b52e-a228-435d-8dc6-aedb5249f4df service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:10:59.727471 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-a7bd3bd8-8185-42f1-935e-c1b401e230f0 req-61d2b52e-a228-435d-8dc6-aedb5249f4df service nova] Creating event network-changed:89a362ec-f588-4c14-a9ae-fb9f4e9f3b40 for instance f3e05138-30c8-48ed-9242-b038dda6754e on hv-cinder-85057 Jul 26 05:10:59.732779 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-a7bd3bd8-8185-42f1-935e-c1b401e230f0 req-61d2b52e-a228-435d-8dc6-aedb5249f4df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032864 Jul 26 05:10:59.733375 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 492/965] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:00.368153 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-fde5b158-9a40-45fe-8062-b202a3db6c5b req-1178998a-bca6-44a9-ac08-cec7a61f1dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12542af7-79b9-4279-ae59-c5ea7941522f", "name": "network-vif-unplugged", "status": "completed", "tag": "f68c75a3-31f1-4414-8479-ccad9fcbea7a"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:11:00.378649 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fde5b158-9a40-45fe-8062-b202a3db6c5b req-1178998a-bca6-44a9-ac08-cec7a61f1dd2 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:00.379141 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fde5b158-9a40-45fe-8062-b202a3db6c5b req-1178998a-bca6-44a9-ac08-cec7a61f1dd2 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:00.394851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-fde5b158-9a40-45fe-8062-b202a3db6c5b req-1178998a-bca6-44a9-ac08-cec7a61f1dd2 service nova] Creating event network-vif-unplugged:f68c75a3-31f1-4414-8479-ccad9fcbea7a for instance 12542af7-79b9-4279-ae59-c5ea7941522f on hv-cinder-85057 Jul 26 05:11:00.400085 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-fde5b158-9a40-45fe-8062-b202a3db6c5b req-1178998a-bca6-44a9-ac08-cec7a61f1dd2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035662 Jul 26 05:11:00.400854 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 474/966] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:00.565272 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:00.567170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:00.574123 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:00.574665 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:00.575542 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:00.576061 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:00.717900 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:00.726058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f7c7ce8a-d968-47d9-81b0-0dae6da8500a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1575 microversion: 2.1 time: 0.165910 Jul 26 05:11:00.726631 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 493/967] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:00 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:01.753271 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:01.754465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:01.764763 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:01.764986 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:01.765848 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:01.766295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:01.900596 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:01.908428 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5a18b780-30e4-4373-ab2e-433322691c03 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1575 microversion: 2.1 time: 0.163206 Jul 26 05:11:01.908977 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 475/968] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:01 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:02.930078 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:02.930693 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:02.938130 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:02.938557 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:02.939321 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:02.939824 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:03.082614 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:03.090929 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-8b1346ac-94a8-4cf8-800c-eded66575873 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1575 microversion: 2.1 time: 0.164921 Jul 26 05:11:03.091613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 494/969] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:02 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:04.117232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:04.118182 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:04.129186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:04.129962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:04.131185 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:04.131966 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:04.272244 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:04.280035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f7a1b9dc-03e5-452b-acd4-da7d4fa5f7c9 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1575 microversion: 2.1 time: 0.169586 Jul 26 05:11:04.280585 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 476/970] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:04 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:05.305315 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:05.306356 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:05.315048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:05.315489 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:05.316280 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:05.316707 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:05.320834 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:11:05.456167 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:05.467461 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-af80b2b7-013c-4c8c-9d50-4b0bc7e872af tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1575 microversion: 2.1 time: 0.168625 Jul 26 05:11:05.468313 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 495/971] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:05 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:06.495754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:06.496766 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:06.504226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:06.504678 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:06.505453 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:06.505883 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:06.646539 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:06.654911 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9a210682-225e-4f2e-9501-49c553778435 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1575 microversion: 2.1 time: 0.164385 Jul 26 05:11:06.655476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 477/972] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:06 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:07.675844 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:07.676480 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:07.683940 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:07.684392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:07.685158 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:07.685588 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:07.869397 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:07.877377 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5ad7d844-7d1d-46a5-81f9-050a7d689c92 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1562 microversion: 2.1 time: 0.205536 Jul 26 05:11:07.877957 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 496/973] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:07 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1562 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:10.447273 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-a38c2f0a-234c-475b-a690-a13b83c2bf20 req-cbf54c12-0db3-4f15-bc5b-bc002a8a3667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12542af7-79b9-4279-ae59-c5ea7941522f", "name": "network-vif-plugged", "status": "completed", "tag": "f68c75a3-31f1-4414-8479-ccad9fcbea7a"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:11:10.456896 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a38c2f0a-234c-475b-a690-a13b83c2bf20 req-cbf54c12-0db3-4f15-bc5b-bc002a8a3667 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:10.457328 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a38c2f0a-234c-475b-a690-a13b83c2bf20 req-cbf54c12-0db3-4f15-bc5b-bc002a8a3667 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:10.469072 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-a38c2f0a-234c-475b-a690-a13b83c2bf20 req-cbf54c12-0db3-4f15-bc5b-bc002a8a3667 service nova] Creating event network-vif-plugged:f68c75a3-31f1-4414-8479-ccad9fcbea7a for instance 12542af7-79b9-4279-ae59-c5ea7941522f on hv-cinder-85057 Jul 26 05:11:10.474230 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-a38c2f0a-234c-475b-a690-a13b83c2bf20 req-cbf54c12-0db3-4f15-bc5b-bc002a8a3667 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159988 Jul 26 05:11:10.474980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 478/974] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:34.251982 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-92e9dccd-a73b-4472-bcd8-19aa0705b8a5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:34.252684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-92e9dccd-a73b-4472-bcd8-19aa0705b8a5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:34.254988 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=11 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:11:34.255844 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=10 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:11:34.262627 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92e9dccd-a73b-4472-bcd8-19aa0705b8a5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:34.263092 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92e9dccd-a73b-4472-bcd8-19aa0705b8a5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:34.263897 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92e9dccd-a73b-4472-bcd8-19aa0705b8a5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:34.264331 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-92e9dccd-a73b-4472-bcd8-19aa0705b8a5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:34.287839 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-92e9dccd-a73b-4472-bcd8-19aa0705b8a5 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/ips" status: 200 len: 150 microversion: 2.1 time: 0.041160 Jul 26 05:11:34.288428 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 497/975] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:11:34 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:35.644066 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=13 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:11:35.644754 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:11:35.649482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c3c14c0d-316c-4dc4-a7c2-adbd92023e31 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a658dc53-ad79-4e8c-a156-e7b2f53a9de8"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:11:35.651933 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c3c14c0d-316c-4dc4-a7c2-adbd92023e31 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:35.659098 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3c14c0d-316c-4dc4-a7c2-adbd92023e31 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:35.659594 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3c14c0d-316c-4dc4-a7c2-adbd92023e31 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:35.660391 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3c14c0d-316c-4dc4-a7c2-adbd92023e31 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:35.660817 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c3c14c0d-316c-4dc4-a7c2-adbd92023e31 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:35.939454 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c3c14c0d-316c-4dc4-a7c2-adbd92023e31 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "POST /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297098 Jul 26 05:11:35.940103 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 479/976] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:11:35 2022] POST /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:43.637176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:43.637712 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:43.644629 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:43.645012 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:43.645769 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:43.646197 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:43.766690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lazy-loading 'services' on Instance uuid f3e05138-30c8-48ed-9242-b038dda6754e {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:11:43.890740 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-903e7cb4-5a58-4b96-a482-4a05c52cc4dc tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments/a658dc53-ad79-4e8c-a156-e7b2f53a9de8" status: 202 len: 0 microversion: 2.1 time: 0.257435 Jul 26 05:11:43.891329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 498/977] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:11:43 2022] DELETE /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments/a658dc53-ad79-4e8c-a156-e7b2f53a9de8 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:11:43.901939 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-002a99ce-2ea3-42ae-815d-0bace75ecdbd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:43.904305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-002a99ce-2ea3-42ae-815d-0bace75ecdbd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:43.911962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-002a99ce-2ea3-42ae-815d-0bace75ecdbd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:43.912425 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-002a99ce-2ea3-42ae-815d-0bace75ecdbd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:43.913182 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-002a99ce-2ea3-42ae-815d-0bace75ecdbd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:43.913611 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-002a99ce-2ea3-42ae-815d-0bace75ecdbd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:43.944438 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-002a99ce-2ea3-42ae-815d-0bace75ecdbd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048335 Jul 26 05:11:43.944980 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 480/978] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:11:43 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:11:44.963693 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-7c7eaa26-f83c-421b-ae95-430dffefca46 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:44.966287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-7c7eaa26-f83c-421b-ae95-430dffefca46 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:44.974138 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7eaa26-f83c-421b-ae95-430dffefca46 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:44.974656 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7eaa26-f83c-421b-ae95-430dffefca46 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:44.975579 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7eaa26-f83c-421b-ae95-430dffefca46 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:44.976089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-7c7eaa26-f83c-421b-ae95-430dffefca46 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:45.007523 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-7c7eaa26-f83c-421b-ae95-430dffefca46 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051925 Jul 26 05:11:45.008170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 499/979] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Jul 26 05:11:44 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 05:11:45.072328 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:45.072851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:45.079432 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:45.079902 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:45.080651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:45.081084 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:45.105686 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:11:45.186444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9ea8f87d-534b-4a73-b961-02faf0493736 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 204 len: 0 microversion: 2.1 time: 0.117518 Jul 26 05:11:45.187311 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 481/980] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:11:45 2022] DELETE /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:11:45.196279 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:45.196898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:45.203729 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:45.204220 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:45.205029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:45.205457 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:45.352587 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:45.360567 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-80cfaabe-5e0a-4e4b-bab0-382e2eea5cdf tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1683 microversion: 2.1 time: 0.168264 Jul 26 05:11:45.361135 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 500/981] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:45 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:46.388151 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:46.389284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:46.400213 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:46.400652 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:46.401424 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:46.401844 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:46.549418 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:46.557491 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1b5e2a11-ffad-4e01-bccb-823f1658bc00 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1683 microversion: 2.1 time: 0.176573 Jul 26 05:11:46.558065 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 482/982] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:46 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:47.580103 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:47.580686 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:47.587065 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:47.587512 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:47.588329 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:47.588907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:47.681005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92b9d212b86348c6b51a6b02818a0e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4481cb5d2f43c5b60db983132a3e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:11:47.692420 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-dddaecdf-f056-41bf-a27e-fe8721132f0d tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 200 len: 1615 microversion: 2.1 time: 0.116333 Jul 26 05:11:47.693118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 501/983] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:47 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:11:47.746569 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-cae5e7cf-5f4f-41c2-ba9d-187166c0863a req-362a330c-24cf-4edd-a544-2b9b7b67c812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e05138-30c8-48ed-9242-b038dda6754e", "name": "network-vif-deleted", "tag": "89a362ec-f588-4c14-a9ae-fb9f4e9f3b40"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:11:47.756749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-cae5e7cf-5f4f-41c2-ba9d-187166c0863a req-362a330c-24cf-4edd-a544-2b9b7b67c812 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:47.757511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-cae5e7cf-5f4f-41c2-ba9d-187166c0863a req-362a330c-24cf-4edd-a544-2b9b7b67c812 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:47.772026 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-cae5e7cf-5f4f-41c2-ba9d-187166c0863a req-362a330c-24cf-4edd-a544-2b9b7b67c812 service nova] Creating event network-vif-deleted:89a362ec-f588-4c14-a9ae-fb9f4e9f3b40 for instance f3e05138-30c8-48ed-9242-b038dda6754e on hv-cinder-85057 Jul 26 05:11:47.776918 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-cae5e7cf-5f4f-41c2-ba9d-187166c0863a req-362a330c-24cf-4edd-a544-2b9b7b67c812 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128011 Jul 26 05:11:47.777513 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 483/984] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:48.714547 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:48.715105 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:48.722086 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:48.722525 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:48.723263 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:48.723722 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:48.737442 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e HTTP/1.1 Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:11:48.739066 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:48.740691 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'f3e05138-30c8-48ed-9242-b038dda6754e'} Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:48.741582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:48.743048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:48.744869 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:48.744869 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9e3e021a-8cd7-45e9-aa54-0e596f074d94 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 404 len: 111 microversion: 2.1 time: 0.030052 Jul 26 05:11:48.744869 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 502/985] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:48 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:48.750773 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-afabc3de-13eb-485c-acbd-a512a5908866 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '.version_select at 0x7f0e9520a9d0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:48.772441 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-afabc3de-13eb-485c-acbd-a512a5908866 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406220077" status: 202 len: 0 microversion: 2.1 time: 0.026510 Jul 26 05:11:48.773071 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 484/986] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Jul 26 05:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406220077 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:11:50.557404 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:50.557923 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:50.565319 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:50.565770 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:50.566539 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:50.566974 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:50.580708 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e HTTP/1.1 Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:11:50.582287 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.583942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'f3e05138-30c8-48ed-9242-b038dda6754e'} Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:50.584936 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.586396 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.587962 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:50.587962 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c66ca3b1-bbf6-4e75-9f13-dc9ff7a23afa tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 404 len: 111 microversion: 2.1 time: 0.030181 Jul 26 05:11:50.587962 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 503/987] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:11:50 2022] DELETE /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:50.596337 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:50.597147 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: f3e05138-30c8-48ed-9242-b038dda6754e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:50.604835 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:50.605282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:50.606043 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:50.606478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:50.620384 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e HTTP/1.1 Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:11:50.622012 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.623687 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'f3e05138-30c8-48ed-9242-b038dda6754e'} Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:50.624729 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. Jul 26 05:11:50.626358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:50.627825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance f3e05138-30c8-48ed-9242-b038dda6754e could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:50.627825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c6e78284-dc91-467d-af8f-1105a3828d95 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e" status: 404 len: 111 microversion: 2.1 time: 0.030971 Jul 26 05:11:50.627825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 485/988] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:50 2022] GET /compute/v2.1/servers/f3e05138-30c8-48ed-9242-b038dda6754e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:51.774016 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:51.774556 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:51.781505 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.781954 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.782739 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.783177 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.796997 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc HTTP/1.1 Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:11:51.798550 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.800232 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '236b309e-2a0f-4ebf-9d4a-535d718aa7cc'} Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:51.801200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.802464 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.803924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:51.803924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-060c671c-3492-4596-85a4-74554df96e4e tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 404 len: 111 microversion: 2.1 time: 0.029913 Jul 26 05:11:51.803924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 504/989] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:11:51 2022] DELETE /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:51.809482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:51.810195 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 236b309e-2a0f-4ebf-9d4a-535d718aa7cc] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:51.817632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.818081 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.818851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.819282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.833253 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc HTTP/1.1 Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:11:51.834805 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.836497 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '236b309e-2a0f-4ebf-9d4a-535d718aa7cc'} Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:51.837485 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. Jul 26 05:11:51.838961 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.840465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 236b309e-2a0f-4ebf-9d4a-535d718aa7cc could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:51.840465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1b5bd612-e818-4cf7-abc3-53d43d8657bd tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc" status: 404 len: 111 microversion: 2.1 time: 0.031110 Jul 26 05:11:51.840465 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 486/990] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:51 2022] GET /compute/v2.1/servers/236b309e-2a0f-4ebf-9d4a-535d718aa7cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:51.844880 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:51.845386 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:51.851944 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.852393 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.853187 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.853620 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.867164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 HTTP/1.1 Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:11:51.868749 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.870327 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '111ba5fc-f989-4373-b60a-59c603db68c7'} Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:51.871256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.872832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.874611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:51.874611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-243a8f1c-4c67-4023-a887-a255208ac0e6 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 404 len: 111 microversion: 2.1 time: 0.029149 Jul 26 05:11:51.874611 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 505/991] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:11:51 2022] DELETE /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 05:11:51.878628 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:51.879219 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 111ba5fc-f989-4373-b60a-59c603db68c7] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:51.885606 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.886098 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.886864 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:51.887296 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:51.900932 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 HTTP/1.1 Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:11:51.902444 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.904001 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '111ba5fc-f989-4373-b60a-59c603db68c7'} Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:51.904943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. Jul 26 05:11:51.906493 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:51.907919 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 111ba5fc-f989-4373-b60a-59c603db68c7 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:51.907919 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0cc205cb-6f34-4f04-a9e3-58e4c2deae77 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7" status: 404 len: 111 microversion: 2.1 time: 0.029188 Jul 26 05:11:51.907919 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 487/992] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:51 2022] GET /compute/v2.1/servers/111ba5fc-f989-4373-b60a-59c603db68c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:53.081938 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:53.082446 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:53.089126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:53.089563 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:53.090317 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:53.090738 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:53.104048 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b HTTP/1.1 Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:11:53.105594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.107160 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '4bd266ba-c238-47fc-9ff2-1176d4d46a5b'} Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:53.108175 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.109684 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.111212 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:53.111212 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1828f99a-64e4-4934-a496-395483fa5c26 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 404 len: 111 microversion: 2.1 time: 0.028903 Jul 26 05:11:53.111212 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 506/993] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:11:53 2022] DELETE /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:53.117642 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:53.118375 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] [instance: 4bd266ba-c238-47fc-9ff2-1176d4d46a5b] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:11:53.125737 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:53.126186 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:53.126953 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:11:53.127482 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:11:53.141462 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] HTTP exception thrown: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Request method failure captured: Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b HTTP/1.1 Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33aHdCCfNDqSm6UyChsFJ_NmRFyjHuFMhnPuXXIcfapzgNuCFvDYKLeHJCl3njnTfhWPa3ND-uXQbtD47DEQUECEZex7dG90qEMSRuATEY_aks6VZFOtRvhRXrxyT041ZHnsxg-T4oFHKAaSBSMmlgyOnSAcMA8geeK0LVwku-Vikkc Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:11:53.142979 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fd4481cb5d2f43c5b60db983132a3e16"}]}] Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: fd4481cb5d2f43c5b60db983132a3e16 Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-376796662 Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 92b9d212b86348c6b51a6b02818a0e80 Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-376796662-project Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.144739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '4bd266ba-c238-47fc-9ff2-1176d4d46a5b'} Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:11:53.145674 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. Jul 26 05:11:53.147476 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:11:53.149723 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] Returning 404 to user: Instance 4bd266ba-c238-47fc-9ff2-1176d4d46a5b could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:11:53.149723 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f436a95c-0a82-4d99-bb88-6c98f5419178 tempest-AttachVolumeNegativeTest-376796662 tempest-AttachVolumeNegativeTest-376796662-project] 10.222.0.17 "GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b" status: 404 len: 111 microversion: 2.1 time: 0.032938 Jul 26 05:11:53.149723 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 488/994] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:11:53 2022] GET /compute/v2.1/servers/4bd266ba-c238-47fc-9ff2-1176d4d46a5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:11:57.628230 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-39dbbf2e-ca33-442f-b02e-503b3c6521db tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Action: 'create', calling method: .version_select at 0x7f0e9511c280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-815320896"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:11:57.942658 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-39dbbf2e-ca33-442f-b02e-503b3c6521db tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.440231 Jul 26 05:11:57.943577 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 507/995] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Jul 26 05:11:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 05:11:57.955741 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d5c25824-f7e4-430a-814c-399775a654af tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e9520aca0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:58.006080 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d5c25824-f7e4-430a-814c-399775a654af tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05" status: 200 len: 344 microversion: 2.1 time: 0.054073 Jul 26 05:11:58.006706 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 489/996] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 05:11:57 2022] GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:59.025098 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-f4d6d7be-aa27-4b8e-aca8-f00c599e2751 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e95998dc0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:59.082332 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-f4d6d7be-aa27-4b8e-aca8-f00c599e2751 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05" status: 200 len: 345 microversion: 2.1 time: 0.064686 Jul 26 05:11:59.082899 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 508/997] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 05:11:59 2022] GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:59.096180 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f22896a8-406e-46ff-9bda-125dc65201c0 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Action: 'create', calling method: .version_select at 0x7f0e952c21f0>, body: {"snapshot": {"volume_id": "3bbea447-07e3-4093-bf2c-5070ea483f05", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-580198313"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:11:59.249394 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f22896a8-406e-46ff-9bda-125dc65201c0 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.157643 Jul 26 05:11:59.250098 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 490/998] 10.222.0.17 () {60 vars in 1162 bytes} [Tue Jul 26 05:11:59 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:59.261366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-38633aa4-4fd1-4802-abc5-af5c0af37eb1 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e950eb940>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:59.291728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-38633aa4-4fd1-4802-abc5-af5c0af37eb1 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 200 len: 286 microversion: 2.1 time: 0.034402 Jul 26 05:11:59.292453 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 509/999] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:11:59 2022] GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:59.303599 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f99c94e1-423c-4b00-9b3a-40f02a008042 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e955ea820>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:59.334749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f99c94e1-423c-4b00-9b3a-40f02a008042 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034909 Jul 26 05:11:59.335440 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 491/1000] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Jul 26 05:11:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:11:59.346882 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-96cb068a-5d29-4e19-82de-a91e66eedc0c tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e95973430>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:11:59.375977 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-96cb068a-5d29-4e19-82de-a91e66eedc0c tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 200 len: 286 microversion: 2.1 time: 0.033122 Jul 26 05:11:59.376532 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 510/1001] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:11:59 2022] GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:00.390114 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a376852b-debb-40ee-ab3d-25cbc7f32d7b tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e95373dc0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:00.420472 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a376852b-debb-40ee-ab3d-25cbc7f32d7b tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 200 len: 286 microversion: 2.1 time: 0.035152 Jul 26 05:12:00.421044 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 492/1002] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:12:00 2022] GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:01.434613 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-db579ebc-022e-485c-b725-9b06d584fd4a tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e9511c4c0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:01.465843 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-db579ebc-022e-485c-b725-9b06d584fd4a tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 200 len: 286 microversion: 2.1 time: 0.036745 Jul 26 05:12:01.466421 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 511/1003] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:12:01 2022] GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:02.482362 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-84492546-ae6b-437f-9c07-1a88fc02fda0 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e9554e670>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:02.512289 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-84492546-ae6b-437f-9c07-1a88fc02fda0 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 200 len: 287 microversion: 2.1 time: 0.037055 Jul 26 05:12:02.512856 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 493/1004] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:12:02 2022] GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:02.524589 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6221f5d8-860d-49e6-bf9a-1c0d3af45e00 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e950ebee0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:02.582369 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6221f5d8-860d-49e6-bf9a-1c0d3af45e00 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 202 len: 0 microversion: 2.1 time: 0.062058 Jul 26 05:12:02.582942 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 512/1005] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Jul 26 05:12:02 2022] DELETE /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:12:02.591335 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1a59fa42-2a0b-4be3-8bba-2fc078304003 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e9554ef70>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:02.624014 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1a59fa42-2a0b-4be3-8bba-2fc078304003 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 200 len: 286 microversion: 2.1 time: 0.036505 Jul 26 05:12:02.624574 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 494/1006] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:12:02 2022] GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:03.635677 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=20 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:03.636913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:03.644116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4762e707-df66-4221-a1fd-0532480c0351 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e9511cd30>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:03.674488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-4762e707-df66-4221-a1fd-0532480c0351 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] HTTP exception thrown: Snapshot 77fffe42-2ef0-4c35-bc7c-faf730ebd28c could not be found. Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4762e707-df66-4221-a1fd-0532480c0351 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Request method failure captured: Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c HTTP/1.1 Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33ed9SW-_lZCrtADwu-2KjM0ehrOwPgko5P5ETyPUIJ16RYSWaet8WHJI8YauF6a9dT5zg7B0zMHHX1Rk9-yD_QecpBT1n8xUEC16QHxkb2rv8jJ-87Ck9J9Mp7jxYc9zsl6L0UWxzZLZsAMq7cgKtCzH-bOCDUlJVPK4bgd8AXpOrY Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:12:03.677176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}] Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 6b9ead798ac54906ad5cccc7a826daac Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Snapshot 77fffe42-2ef0-4c35-bc7c-faf730ebd28c could not be found. Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '77fffe42-2ef0-4c35-bc7c-faf730ebd28c'} Jul 26 05:12:03.678846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 77fffe42-2ef0-4c35-bc7c-faf730ebd28c could not be found. (HTTP 404) (Request-ID: req-d1de70ea-f62d-4a20-82ff-3e456abda625) Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:03.680096 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:12:03.682395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 77fffe42-2ef0-4c35-bc7c-faf730ebd28c could not be found. Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 05:12:03.685219 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 77fffe42-2ef0-4c35-bc7c-faf730ebd28c could not be found. Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 77fffe42-2ef0-4c35-bc7c-faf730ebd28c could not be found. Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4762e707-df66-4221-a1fd-0532480c0351 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Returning 404 to user: Snapshot 77fffe42-2ef0-4c35-bc7c-faf730ebd28c could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:12:03.687695 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4762e707-df66-4221-a1fd-0532480c0351 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c" status: 404 len: 111 microversion: 2.1 time: 0.044517 Jul 26 05:12:03.688754 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 513/1007] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:12:03 2022] GET /compute/v2.1/os-snapshots/77fffe42-2ef0-4c35-bc7c-faf730ebd28c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:12:03.688851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:03.688851 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:03.691232 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3783f728-7382-4aae-9694-b24f35b80124 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e95126d30>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:03.755128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3783f728-7382-4aae-9694-b24f35b80124 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05" status: 202 len: 0 microversion: 2.1 time: 0.071450 Jul 26 05:12:03.755820 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 495/1008] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:12:03 2022] DELETE /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 05:12:03.764290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-2d03d094-54fa-4f05-b0e8-3764b3b2d621 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e959d0940>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:03.813316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-2d03d094-54fa-4f05-b0e8-3764b3b2d621 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05" status: 200 len: 344 microversion: 2.1 time: 0.052833 Jul 26 05:12:03.813887 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 514/1009] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 05:12:03 2022] GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:04.835266 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1a2123e4-8fcd-483e-971b-a60f6132c7d1 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e95253b80>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:04.867059 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-1a2123e4-8fcd-483e-971b-a60f6132c7d1 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] HTTP exception thrown: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1a2123e4-8fcd-483e-971b-a60f6132c7d1 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Request method failure captured: Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 HTTP/1.1 Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33ed9SW-_lZCrtADwu-2KjM0ehrOwPgko5P5ETyPUIJ16RYSWaet8WHJI8YauF6a9dT5zg7B0zMHHX1Rk9-yD_QecpBT1n8xUEC16QHxkb2rv8jJ-87Ck9J9Mp7jxYc9zsl6L0UWxzZLZsAMq7cgKtCzH-bOCDUlJVPK4bgd8AXpOrY Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:12:04.870404 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}] Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 6b9ead798ac54906ad5cccc7a826daac Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '3bbea447-07e3-4093-bf2c-5070ea483f05'} Jul 26 05:12:04.871987 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. (HTTP 404) (Request-ID: req-c0fd887d-04ef-4359-b420-f4eb0d18d9c4) Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.872846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:12:04.874048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 05:12:04.875240 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1a2123e4-8fcd-483e-971b-a60f6132c7d1 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Returning 404 to user: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1a2123e4-8fcd-483e-971b-a60f6132c7d1 tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05" status: 404 len: 109 microversion: 2.1 time: 0.041703 Jul 26 05:12:04.876861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 496/1010] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 05:12:04 2022] GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:12:04.887215 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ac3371f2-fd37-418b-bade-667cf31e48ea tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e95998670>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:04.914811 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-ac3371f2-fd37-418b-bade-667cf31e48ea tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] HTTP exception thrown: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ac3371f2-fd37-418b-bade-667cf31e48ea tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Request method failure captured: Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: DELETE /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 HTTP/1.1 Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33ed9SW-_lZCrtADwu-2KjM0ehrOwPgko5P5ETyPUIJ16RYSWaet8WHJI8YauF6a9dT5zg7B0zMHHX1Rk9-yD_QecpBT1n8xUEC16QHxkb2rv8jJ-87Ck9J9Mp7jxYc9zsl6L0UWxzZLZsAMq7cgKtCzH-bOCDUlJVPK4bgd8AXpOrY Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:12:04.917146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}] Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 6b9ead798ac54906ad5cccc7a826daac Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '3bbea447-07e3-4093-bf2c-5070ea483f05'} Jul 26 05:12:04.918832 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. (HTTP 404) (Request-ID: req-2e66841b-f8c4-4e12-b5ff-24be0c7b840a) Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.919884 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 05:12:04.921594 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 05:12:04.923118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ac3371f2-fd37-418b-bade-667cf31e48ea tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Returning 404 to user: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ac3371f2-fd37-418b-bade-667cf31e48ea tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05" status: 404 len: 109 microversion: 2.1 time: 0.035662 Jul 26 05:12:04.924675 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 515/1011] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Jul 26 05:12:04 2022] DELETE /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:12:04.927429 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-113521a4-1598-4231-b565-5321b569e81e tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Calling method '.version_select at 0x7f0e9554e700>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:04.955509 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-113521a4-1598-4231-b565-5321b569e81e tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] HTTP exception thrown: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-113521a4-1598-4231-b565-5321b569e81e tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Request method failure captured: Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 HTTP/1.1 Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33ed9SW-_lZCrtADwu-2KjM0ehrOwPgko5P5ETyPUIJ16RYSWaet8WHJI8YauF6a9dT5zg7B0zMHHX1Rk9-yD_QecpBT1n8xUEC16QHxkb2rv8jJ-87Ck9J9Mp7jxYc9zsl6L0UWxzZLZsAMq7cgKtCzH-bOCDUlJVPK4bgd8AXpOrY Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:12:04.957521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6413758618124b4c95d937e8bd7d2e4c"}]}] Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 6413758618124b4c95d937e8bd7d2e4c Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-453207513 Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 6b9ead798ac54906ad5cccc7a826daac Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-453207513-project Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '3bbea447-07e3-4093-bf2c-5070ea483f05'} Jul 26 05:12:04.959231 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. (HTTP 404) (Request-ID: req-29cd8978-45d8-4e90-b075-9f0417e940fc) Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.960305 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 05:12:04.961739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 05:12:04.962989 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-113521a4-1598-4231-b565-5321b569e81e tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] Returning 404 to user: Volume 3bbea447-07e3-4093-bf2c-5070ea483f05 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-113521a4-1598-4231-b565-5321b569e81e tempest-VolumesSnapshotsTestJSON-453207513 tempest-VolumesSnapshotsTestJSON-453207513-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05" status: 404 len: 109 microversion: 2.1 time: 0.035583 Jul 26 05:12:04.964467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 497/1012] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Jul 26 05:12:04 2022] GET /compute/v2.1/os-volumes/3bbea447-07e3-4093-bf2c-5070ea483f05 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:12:21.209027 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1597923019", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:21.261676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.network.neutron [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] validate_networks() for None {{(pid=117994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:12:21.534775 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Flavor limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:12:21.535194 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Image limits 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:12:21.535696 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Flavor pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:12:21.536099 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Image pref 0:0:0 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:12:21.536507 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.virt.hardware [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:12:21.549520 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:21.550180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:21.551333 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:21.552027 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:21.575592 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Getting quotas for project 487ac0c07ad444ffa66858feeba7bcee. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:12:21.579582 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.quota [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Getting quotas for user cee98f2141b64b27a00361cd1b232e6c and project 487ac0c07ad444ffa66858feeba7bcee. Resources: {'cores', 'instances', 'ram'} {{(pid=117994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:12:21.591661 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Going to run 1 instances... {{(pid=117994) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:12:21.594026 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:12:21.637290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ba9264f9-2a08-4263-99b3-4d253c2103ec tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434347 Jul 26 05:12:21.637966 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 516/1013] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:12:21.650543 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2c68fa9b-057f-4c16-8eb3-97eb9106fd16 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:21.651055 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2c68fa9b-057f-4c16-8eb3-97eb9106fd16 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:21.708677 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2c68fa9b-057f-4c16-8eb3-97eb9106fd16 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:21.715999 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2c68fa9b-057f-4c16-8eb3-97eb9106fd16 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1215 microversion: 2.1 time: 0.070795 Jul 26 05:12:21.717604 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 498/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:21 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:22.737967 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:22.738566 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:22.745252 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:22.745668 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:22.746440 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:22.746875 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:22.826069 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:22.834011 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-a583c660-3a28-454d-9343-07df5f879ad1 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1275 microversion: 2.1 time: 0.100636 Jul 26 05:12:22.834834 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 517/1015] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:22 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:23.855354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:23.856070 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:23.866723 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:23.867883 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:23.869237 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:23.874982 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:24.060894 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:24.069347 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4c4fb22b-53e6-4d32-93a5-77af76becd00 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1315 microversion: 2.1 time: 0.217977 Jul 26 05:12:24.070639 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 499/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:23 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:24.337375 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:24.338784 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:24.353296 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:24.353743 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:24.354522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:24.354944 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:24.396291 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:12:24.515281 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-01e7e86f-f374-4373-aefc-35c05de52bc7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "DELETE /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 204 len: 0 microversion: 2.1 time: 0.181463 Jul 26 05:12:24.516005 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 518/1017] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:12:24 2022] DELETE /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:12:24.529035 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-d23d1125-8c49-4385-a0a0-c724cfa32177 req-5a41839d-e8f8-45b9-8152-751f935b20e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e4bf4e-1fbb-491f-8fc4-02864614f900", "tag": "a7dd557f-1449-4e24-b4de-5bf8c52d075e"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:24.552003 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d23d1125-8c49-4385-a0a0-c724cfa32177 req-5a41839d-e8f8-45b9-8152-751f935b20e1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:24.552949 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-d23d1125-8c49-4385-a0a0-c724cfa32177 req-5a41839d-e8f8-45b9-8152-751f935b20e1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:24.568542 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-d23d1125-8c49-4385-a0a0-c724cfa32177 req-5a41839d-e8f8-45b9-8152-751f935b20e1 service nova] Creating event network-changed:a7dd557f-1449-4e24-b4de-5bf8c52d075e for instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 on hv-cinder-85057 Jul 26 05:12:24.573953 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-d23d1125-8c49-4385-a0a0-c724cfa32177 req-5a41839d-e8f8-45b9-8152-751f935b20e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054744 Jul 26 05:12:24.574736 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 519/1018] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:24.583235 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:24.583959 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:24.590902 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:24.591364 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:24.592126 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:24.592809 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:24.620121 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-5a195d64-2b4c-4d17-beca-6de4dc5485bf req-3c0b7b57-99ec-49d8-ad35-ac4f6d5806c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12542af7-79b9-4279-ae59-c5ea7941522f", "tag": "f68c75a3-31f1-4414-8479-ccad9fcbea7a"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:24.631684 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5a195d64-2b4c-4d17-beca-6de4dc5485bf req-3c0b7b57-99ec-49d8-ad35-ac4f6d5806c1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:24.632474 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5a195d64-2b4c-4d17-beca-6de4dc5485bf req-3c0b7b57-99ec-49d8-ad35-ac4f6d5806c1 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:24.646375 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-5a195d64-2b4c-4d17-beca-6de4dc5485bf req-3c0b7b57-99ec-49d8-ad35-ac4f6d5806c1 service nova] Creating event network-changed:f68c75a3-31f1-4414-8479-ccad9fcbea7a for instance 12542af7-79b9-4279-ae59-c5ea7941522f on hv-cinder-85057 Jul 26 05:12:24.656568 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-5a195d64-2b4c-4d17-beca-6de4dc5485bf req-3c0b7b57-99ec-49d8-ad35-ac4f6d5806c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310110 Jul 26 05:12:24.657419 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 500/1019] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 05:12:24.736446 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:24.744275 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-21c21daf-f9e9-417d-9231-1432fba77fb7 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.165636 Jul 26 05:12:24.744846 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 520/1020] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:24 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:25.091511 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:25.092109 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:25.098686 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:25.099151 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:25.099943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:25.100401 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:25.236633 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:25.244442 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-06d3a2de-33f6-428e-a22b-52b7d21cef30 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1315 microversion: 2.1 time: 0.157735 Jul 26 05:12:25.245025 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 501/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:25 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:25.768490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:25.769090 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:25.776639 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:25.777089 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:25.777864 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:25.778299 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:25.958796 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:25.970050 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-cbcb0779-b9f1-444b-94e1-9e28786bcc1a tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1568 microversion: 2.1 time: 0.207217 Jul 26 05:12:25.970751 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 521/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:25 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:26.266149 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:26.266914 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:26.274135 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:26.274718 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:26.275593 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:26.276188 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:26.573254 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:26.586845 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7d5077b7-be35-4161-a500-26fa3f7a590c tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1315 microversion: 2.1 time: 0.323900 Jul 26 05:12:26.604297 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 502/1023] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:26 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:26.671773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-2152b473-3fac-4bed-b75f-9fb487541123 req-9aac2264-0c16-4331-be30-000a36877bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12542af7-79b9-4279-ae59-c5ea7941522f", "name": "network-vif-deleted", "tag": "f68c75a3-31f1-4414-8479-ccad9fcbea7a"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:26.681800 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2152b473-3fac-4bed-b75f-9fb487541123 req-9aac2264-0c16-4331-be30-000a36877bdf service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:26.682336 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-2152b473-3fac-4bed-b75f-9fb487541123 req-9aac2264-0c16-4331-be30-000a36877bdf service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:26.693753 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-2152b473-3fac-4bed-b75f-9fb487541123 req-9aac2264-0c16-4331-be30-000a36877bdf service nova] Creating event network-vif-deleted:f68c75a3-31f1-4414-8479-ccad9fcbea7a for instance 12542af7-79b9-4279-ae59-c5ea7941522f on hv-cinder-85057 Jul 26 05:12:26.698686 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-2152b473-3fac-4bed-b75f-9fb487541123 req-9aac2264-0c16-4331-be30-000a36877bdf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031030 Jul 26 05:12:26.699305 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 522/1024] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:26.992995 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:26.993611 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:27.000530 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:27.001060 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:27.001948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:27.002450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:27.066530 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:27.074369 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ffbe6a26-ca89-455a-a1d7-25bf7846cf48 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1500 microversion: 2.1 time: 0.085420 Jul 26 05:12:27.074962 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 503/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:26 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1500 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:27.610451 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:27.611858 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:27.619109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:27.619583 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:27.620374 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:27.620821 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:27.833389 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:27.841518 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-84fa29c8-971e-42fa-8bc3-5747c6d9d5e3 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1315 microversion: 2.1 time: 0.235771 Jul 26 05:12:27.842385 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 523/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:27 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:28.096334 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:28.096982 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:28.104812 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:28.105212 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:28.106376 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:28.106480 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:28.141471 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:28.142357 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:28.143143 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lazy-loading 'fault' on Instance uuid 12542af7-79b9-4279-ae59-c5ea7941522f {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:12:28.227575 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca4c30c05b1498f861242024880f2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666f12ad571f45c096947d0497291842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:28.234601 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ecbb5d07-7db0-45b7-83a1-935eaf6e8752 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 200 len: 1178 microversion: 2.1 time: 0.142685 Jul 26 05:12:28.235187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 504/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:28 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 1178 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:28.862772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:28.863395 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:28.870151 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:28.870604 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:28.871419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:28.871898 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:29.016352 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:29.028290 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-41330217-da64-41b2-8a98-877005a00a62 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1315 microversion: 2.1 time: 0.169061 Jul 26 05:12:29.029161 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 524/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:28 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:29.256982 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:29.257672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] [instance: 12542af7-79b9-4279-ae59-c5ea7941522f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:29.266578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:29.267187 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:29.268252 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:29.268821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:29.283683 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] HTTP exception thrown: Instance 12542af7-79b9-4279-ae59-c5ea7941522f could not be found. Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Request method failure captured: Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f HTTP/1.1 Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33agZgCBbbVzZIEHkgiwq0UFRwnPeW1aO0Lp5fFohELo6Ja4iPvXcNrjhmQO0ALBiSdXzJHcSY4ttYl5gg05tn0E6V3ejxmn8XonlW2wrLxMcAYX0rwUqyfhq2E0Ew_chRGCfuVj6lWcgX_3yAX9H8uUaUPB2vSAIxPy1wZYDLMU-BU Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 666f12ad571f45c096947d0497291842 Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-TestShelveInstance-438752850 Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:12:29.285330 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/666f12ad571f45c096947d0497291842"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_666f12ad571f45c096947d0497291842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/666f12ad571f45c096947d0497291842"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/666f12ad571f45c096947d0497291842"}]}] Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-TestShelveInstance-438752850 Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 666f12ad571f45c096947d0497291842 Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-TestShelveInstance-438752850 Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-TestShelveInstance-438752850-project Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: bca4c30c05b1498f861242024880f2e4 Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-TestShelveInstance-438752850-project Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance 12542af7-79b9-4279-ae59-c5ea7941522f could not be found. Jul 26 05:12:29.286948 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': '12542af7-79b9-4279-ae59-c5ea7941522f'} Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12542af7-79b9-4279-ae59-c5ea7941522f could not be found. Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:12:29.287940 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12542af7-79b9-4279-ae59-c5ea7941522f could not be found. Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12542af7-79b9-4279-ae59-c5ea7941522f could not be found. Jul 26 05:12:29.289638 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:12:29.291052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Returning 404 to user: Instance 12542af7-79b9-4279-ae59-c5ea7941522f could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:12:29.291052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-04588e49-4c2f-4d4d-9661-9ae4624817c0 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f" status: 404 len: 111 microversion: 2.1 time: 0.034424 Jul 26 05:12:29.291052 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 505/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:29 2022] GET /compute/v2.1/servers/12542af7-79b9-4279-ae59-c5ea7941522f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:12:29.467316 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5fd74cfa-c5e6-4a40-88a8-0f749f0101d6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] Calling method '.version_select at 0x7f0e9511c3a0>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:29.489772 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5fd74cfa-c5e6-4a40-88a8-0f749f0101d6 tempest-TestShelveInstance-438752850 tempest-TestShelveInstance-438752850-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-219346942" status: 202 len: 0 microversion: 2.1 time: 0.026423 Jul 26 05:12:29.490376 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 525/1030] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Jul 26 05:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-219346942 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:12:30.050496 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:30.051142 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:30.057506 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:30.057957 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:30.058727 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:30.059527 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:30.235381 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:30.243358 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2de8281b-ffa7-4485-9ee3-aeadb1c4612f tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1315 microversion: 2.1 time: 0.196852 Jul 26 05:12:30.243963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 506/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:30 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:30.719536 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-3abd1d3d-4982-423d-bc5b-04ebc6041e3a req-df5066f3-081c-4fa1-b36b-9af244165cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e4bf4e-1fbb-491f-8fc4-02864614f900", "name": "network-vif-plugged", "status": "completed", "tag": "a7dd557f-1449-4e24-b4de-5bf8c52d075e"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:30.730988 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3abd1d3d-4982-423d-bc5b-04ebc6041e3a req-df5066f3-081c-4fa1-b36b-9af244165cbf service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:30.731402 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-3abd1d3d-4982-423d-bc5b-04ebc6041e3a req-df5066f3-081c-4fa1-b36b-9af244165cbf service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:30.742921 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-3abd1d3d-4982-423d-bc5b-04ebc6041e3a req-df5066f3-081c-4fa1-b36b-9af244165cbf service nova] Creating event network-vif-plugged:a7dd557f-1449-4e24-b4de-5bf8c52d075e for instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 on hv-cinder-85057 Jul 26 05:12:30.747878 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-3abd1d3d-4982-423d-bc5b-04ebc6041e3a req-df5066f3-081c-4fa1-b36b-9af244165cbf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Jul 26 05:12:30.748825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 526/1032] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:31.264554 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:31.265935 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:31.272744 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:31.273383 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:31.274209 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:31.274846 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:31.434615 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:31.442564 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3c91af45-3b4c-4228-b41a-63adaa34031e tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1315 microversion: 2.1 time: 0.181763 Jul 26 05:12:31.443519 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 507/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:31 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:32.472064 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:32.473449 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:32.505247 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:32.506120 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=6 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:32.512548 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:32.513164 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:32.514092 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:32.514718 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:32.659714 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:32.667887 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5c95bae3-121c-43fa-8f04-5762a862b732 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1464 microversion: 2.1 time: 0.207957 Jul 26 05:12:32.668474 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 527/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:32 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:32.716213 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:32.717370 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:32.719547 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:32.726821 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:32.727269 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:32.728087 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:32.728521 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:32.755397 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:12:32.838950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-24cbc54a-c755-4ef1-b6ec-c076eb15b855 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "DELETE /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 204 len: 0 microversion: 2.1 time: 0.126225 Jul 26 05:12:32.839692 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 508/1035] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:12:32 2022] DELETE /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:12:32.848109 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:32.849950 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:32.856622 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:32.857180 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:32.858029 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:32.858527 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:32.993334 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:33.001242 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-55fe05e0-ca4c-4827-9516-61494a27c822 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1470 microversion: 2.1 time: 0.157003 Jul 26 05:12:33.001907 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 528/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:32 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:34.022956 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:34.023578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:34.030116 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:34.030562 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:34.031353 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:34.031816 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:34.163315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:34.173007 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ce4f70a6-c7af-4bd4-9722-bd232120c032 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1470 microversion: 2.1 time: 0.154606 Jul 26 05:12:34.173609 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 509/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:34 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:35.018408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-8ef0505b-629e-45f5-a192-f2cf8d6568e9 req-0b5c0787-142f-4594-8f2f-6e29d6b8e230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e4bf4e-1fbb-491f-8fc4-02864614f900", "name": "network-vif-deleted", "tag": "a7dd557f-1449-4e24-b4de-5bf8c52d075e"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:35.032116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8ef0505b-629e-45f5-a192-f2cf8d6568e9 req-0b5c0787-142f-4594-8f2f-6e29d6b8e230 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:35.032903 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-8ef0505b-629e-45f5-a192-f2cf8d6568e9 req-0b5c0787-142f-4594-8f2f-6e29d6b8e230 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:35.047782 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-8ef0505b-629e-45f5-a192-f2cf8d6568e9 req-0b5c0787-142f-4594-8f2f-6e29d6b8e230 service nova] Creating event network-vif-deleted:a7dd557f-1449-4e24-b4de-5bf8c52d075e for instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 on hv-cinder-85057 Jul 26 05:12:35.053115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-8ef0505b-629e-45f5-a192-f2cf8d6568e9 req-0b5c0787-142f-4594-8f2f-6e29d6b8e230 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038520 Jul 26 05:12:35.054689 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 529/1038] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:35.197887 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:35.198507 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:35.205390 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:35.205877 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:35.207588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:35.208301 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:35.242876 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:35.243588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:35.244352 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lazy-loading 'fault' on Instance uuid 83e4bf4e-1fbb-491f-8fc4-02864614f900 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:12:35.312923 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee98f2141b64b27a00361cd1b232e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487ac0c07ad444ffa66858feeba7bcee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:35.320812 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-320e205e-1c1a-4826-8a09-d8111cf03948 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 200 len: 1305 microversion: 2.1 time: 0.130072 Jul 26 05:12:35.321564 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 510/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:35 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:36.343378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:36.344646 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] [instance: 83e4bf4e-1fbb-491f-8fc4-02864614f900] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:36.351715 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:36.352169 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:36.352947 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:36.353427 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:36.367063 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] HTTP exception thrown: Instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 could not be found. Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Request method failure captured: Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 HTTP/1.1 Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33ezHx31TpyiXhQ2SedqcCTUdfbDZtMe7tqmZBW0bQEBK7hWmYMtglk0kEzLYo_VYmVe2qHqDLlzwCdRzieYCOzRR3TrAJZ3yTcR78WzsdkjpWg6OWpLZ-LrT822YKvwPZ2txHTibMyQ02xdJXj-Ndfnu-O7QqQgtuRx96j5rt7Nq34 Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 487ac0c07ad444ffa66858feeba7bcee Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesNegativeTest-1111982578 Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:12:36.368773 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/487ac0c07ad444ffa66858feeba7bcee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_487ac0c07ad444ffa66858feeba7bcee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/487ac0c07ad444ffa66858feeba7bcee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/487ac0c07ad444ffa66858feeba7bcee"}]}] Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesNegativeTest-1111982578 Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 487ac0c07ad444ffa66858feeba7bcee Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesNegativeTest-1111982578 Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesNegativeTest-1111982578-project Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: cee98f2141b64b27a00361cd1b232e6c Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesNegativeTest-1111982578-project Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 could not be found. Jul 26 05:12:36.370473 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': '83e4bf4e-1fbb-491f-8fc4-02864614f900'} Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 could not be found. Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:12:36.371490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 could not be found. Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 could not be found. Jul 26 05:12:36.373176 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:12:36.374467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] Returning 404 to user: Instance 83e4bf4e-1fbb-491f-8fc4-02864614f900 could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:12:36.374467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-b27b7fe9-9674-43db-8f13-b7d852ad7fa7 tempest-VolumesNegativeTest-1111982578 tempest-VolumesNegativeTest-1111982578-project] 10.222.0.17 "GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900" status: 404 len: 111 microversion: 2.1 time: 0.031198 Jul 26 05:12:36.374929 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 530/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:36 2022] GET /compute/v2.1/servers/83e4bf4e-1fbb-491f-8fc4-02864614f900 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:12:44.110065 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1697359860", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "networks": [{"uuid": "f3941d81-f5ed-4186-b07a-def8af852774"}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:44.162801 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] validate_networks() for [('f3941d81-f5ed-4186-b07a-def8af852774', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:12:44.518943 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:12:44.519544 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:12:44.520228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:12:44.520836 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:12:44.521323 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:12:44.535963 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:44.536629 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:44.537888 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:44.538522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:44.559861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Getting quotas for project 1ef8f9da4d8148aebe552f9733dbc45a. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:12:44.564292 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Getting quotas for user 832161ae82a74a03b6ad578386ed0bb4 and project 1ef8f9da4d8148aebe552f9733dbc45a. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:12:44.576487 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:12:44.578776 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:12:44.629949 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ed90c1cf-3c37-4336-9b06-6da7723abe3d tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524184 Jul 26 05:12:44.630739 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 511/1041] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:12:44.641854 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4417bf24-00e1-48a0-a8e4-c44f5b664fd6 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:44.642474 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4417bf24-00e1-48a0-a8e4-c44f5b664fd6 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:44.697452 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-4417bf24-00e1-48a0-a8e4-c44f5b664fd6 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:44.704490 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4417bf24-00e1-48a0-a8e4-c44f5b664fd6 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1219 microversion: 2.1 time: 0.066571 Jul 26 05:12:44.705116 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 531/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:44 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:45.726373 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:45.727749 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:45.736615 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:45.737479 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:45.738602 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:45.739089 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:46.095058 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:46.103227 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-92ff78fe-de2b-4c0d-af8d-e99d740b29ed tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1289 microversion: 2.1 time: 0.381942 Jul 26 05:12:46.103922 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 512/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:45 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1289 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:47.124521 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:47.125121 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:47.127108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:47.133673 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:47.134153 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:47.134924 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:47.135467 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:47.338644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:47.347309 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-ec6976c2-9d3a-4729-9a3a-17a3a51f01e9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1319 microversion: 2.1 time: 0.226845 Jul 26 05:12:47.347913 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 532/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:47 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:47.381397 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-d0443985-8c65-4eaf-9e77-6439f7350ee5 req-cfe628af-22a7-49ea-b1b8-7e1d3a015ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca", "tag": "35f88b37-ae8e-4b94-9860-96f830b1f89c"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:47.391972 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-d0443985-8c65-4eaf-9e77-6439f7350ee5 req-cfe628af-22a7-49ea-b1b8-7e1d3a015ada service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:47.392464 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-d0443985-8c65-4eaf-9e77-6439f7350ee5 req-cfe628af-22a7-49ea-b1b8-7e1d3a015ada service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:47.404742 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-d0443985-8c65-4eaf-9e77-6439f7350ee5 req-cfe628af-22a7-49ea-b1b8-7e1d3a015ada service nova] Creating event network-changed:35f88b37-ae8e-4b94-9860-96f830b1f89c for instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca on hv-cinder-85057 Jul 26 05:12:47.409709 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-d0443985-8c65-4eaf-9e77-6439f7350ee5 req-cfe628af-22a7-49ea-b1b8-7e1d3a015ada service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032055 Jul 26 05:12:47.410310 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 513/1045] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:48.370100 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:48.370823 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:48.377887 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:48.379145 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:48.380115 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:48.380555 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:48.520653 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:48.528690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-766223d6-1bd4-4986-a18f-7f451eb92067 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1319 microversion: 2.1 time: 0.162607 Jul 26 05:12:48.529256 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 533/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:48 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:49.555661 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:49.556840 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:49.567781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:49.568531 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:49.569803 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:49.570518 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:49.713755 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:49.721550 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-785441e4-07f8-4b16-ac78-3a9f8cb37131 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1319 microversion: 2.1 time: 0.173795 Jul 26 05:12:49.722136 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 514/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:49 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:50.742996 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:50.743623 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:50.750761 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:50.751210 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:50.752022 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:50.752453 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:50.885118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:50.892752 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-6c5caa80-6706-4f4c-add3-c7b6db83592a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1319 microversion: 2.1 time: 0.153879 Jul 26 05:12:50.893392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 534/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:50 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:51.918502 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:51.919112 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:51.921697 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:51.927825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:51.928314 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:51.929108 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:51.929551 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:51.932651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:52.065672 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:52.073600 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-62542b7f-0d94-4f74-bc88-8456c7c967ce tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1319 microversion: 2.1 time: 0.161503 Jul 26 05:12:52.074295 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 515/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:51 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:52.831248 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-077abacc-b53a-4df2-950a-564abf02f7ea req-e35cd751-e98c-4a53-9a9d-3e98cb39cac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca", "name": "network-vif-plugged", "status": "completed", "tag": "35f88b37-ae8e-4b94-9860-96f830b1f89c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:12:52.836606 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:12:52.843804 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-077abacc-b53a-4df2-950a-564abf02f7ea req-e35cd751-e98c-4a53-9a9d-3e98cb39cac4 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:52.844246 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-077abacc-b53a-4df2-950a-564abf02f7ea req-e35cd751-e98c-4a53-9a9d-3e98cb39cac4 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:52.856450 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-077abacc-b53a-4df2-950a-564abf02f7ea req-e35cd751-e98c-4a53-9a9d-3e98cb39cac4 service nova] Creating event network-vif-plugged:35f88b37-ae8e-4b94-9860-96f830b1f89c for instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca on hv-cinder-85057 Jul 26 05:12:52.861398 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-077abacc-b53a-4df2-950a-564abf02f7ea req-e35cd751-e98c-4a53-9a9d-3e98cb39cac4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034016 Jul 26 05:12:52.861987 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 535/1050] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:12:53.095214 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:53.095646 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:53.102388 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:53.102839 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:53.103653 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:53.105035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:53.241895 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:53.249623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-929f8e89-07e5-43f8-9858-20f9600291b2 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1319 microversion: 2.1 time: 0.158855 Jul 26 05:12:53.250196 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 516/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:53 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:12:54.277122 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:12:54.278296 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:12:54.290392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:54.291200 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:54.292701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:12:54.293429 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:12:54.427057 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:12:54.435366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-fa44a6f8-3c18-46b8-bb6e-ba451ac8cab1 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1508 microversion: 2.1 time: 0.166803 Jul 26 05:12:54.435966 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 536/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:12:54 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:08.635379 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ecea9ca7-59de-4b03-8ffa-e7ba376523d7 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f37f640b-8dfe-4a87-8158-352a550752f1", "device": "/dev/sdb"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:13:08.638648 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ecea9ca7-59de-4b03-8ffa-e7ba376523d7 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:08.641874 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:08.642825 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:08.643669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:08.644371 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=11 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:08.652475 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecea9ca7-59de-4b03-8ffa-e7ba376523d7 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:08.653036 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecea9ca7-59de-4b03-8ffa-e7ba376523d7 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:08.653801 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecea9ca7-59de-4b03-8ffa-e7ba376523d7 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:08.654223 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ecea9ca7-59de-4b03-8ffa-e7ba376523d7 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:08.961181 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ecea9ca7-59de-4b03-8ffa-e7ba376523d7 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "POST /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331176 Jul 26 05:13:08.962074 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 517/1053] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:13:08 2022] POST /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:13:29.744825 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:29.745358 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:29.747929 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:29.748643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=3 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:29.749346 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=26 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:29.755861 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:29.756308 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:29.757080 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:29.757517 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:29.849486 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lazy-loading 'services' on Instance uuid ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:13:29.933678 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-95eee996-0237-4d27-9a08-7df6fdafbee9 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca/os-volume_attachments/f37f640b-8dfe-4a87-8158-352a550752f1" status: 202 len: 0 microversion: 2.1 time: 0.192563 Jul 26 05:13:29.934655 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 537/1054] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:13:29 2022] DELETE /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca/os-volume_attachments/f37f640b-8dfe-4a87-8158-352a550752f1 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:13:31.064174 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:31.064950 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:31.069396 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:31.069978 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:31.077600 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:31.078038 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:31.078828 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:31.079258 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:31.111473 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:13:31.202076 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6355a978-3187-43e6-9f95-25a9361a81ca tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 204 len: 0 microversion: 2.1 time: 0.138710 Jul 26 05:13:31.202815 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 518/1055] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:13:31 2022] DELETE /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:13:31.212522 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:31.213429 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:31.220157 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:31.220601 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:31.221366 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:31.221826 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:31.357531 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:31.365561 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-60ca976d-2f6c-4408-8507-eb8023ba0a01 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1514 microversion: 2.1 time: 0.158020 Jul 26 05:13:31.366146 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 538/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:31 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:32.388326 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:32.389018 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:32.395853 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:32.396299 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:32.397060 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:32.397490 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:32.539226 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:32.548463 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b0967015-4c34-4a4f-87b7-a02afc3ced92 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1514 microversion: 2.1 time: 0.164510 Jul 26 05:13:32.549048 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 519/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:32 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:33.337107 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [req-56fc825c-2bf0-4559-80df-c3429ae39c31 req-24220842-7f38-4440-9de6-a7d5d7339766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca", "name": "network-vif-deleted", "tag": "35f88b37-ae8e-4b94-9860-96f830b1f89c"}]} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:13:33.347221 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-56fc825c-2bf0-4559-80df-c3429ae39c31 req-24220842-7f38-4440-9de6-a7d5d7339766 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:33.347670 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [req-56fc825c-2bf0-4559-80df-c3429ae39c31 req-24220842-7f38-4440-9de6-a7d5d7339766 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:33.358501 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.compute.server_external_events [req-56fc825c-2bf0-4559-80df-c3429ae39c31 req-24220842-7f38-4440-9de6-a7d5d7339766 service nova] Creating event network-vif-deleted:35f88b37-ae8e-4b94-9860-96f830b1f89c for instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca on hv-cinder-85057 Jul 26 05:13:33.363300 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [req-56fc825c-2bf0-4559-80df-c3429ae39c31 req-24220842-7f38-4440-9de6-a7d5d7339766 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030057 Jul 26 05:13:33.364162 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 539/1058] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:13:33.569942 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:33.570558 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:33.577302 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:33.577744 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:33.578548 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:33.579006 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:33.612775 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:33.613211 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:33.613651 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lazy-loading 'fault' on Instance uuid ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:13:33.656178 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:33.663716 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-248adc09-dd8c-4b8b-a3ef-41f232a3a472 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 200 len: 1309 microversion: 2.1 time: 0.097854 Jul 26 05:13:33.664282 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 520/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:33 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:34.689394 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:34.690182 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:34.698423 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:34.698959 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:34.699954 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:34.700495 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:34.717070 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.wsgi [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] HTTP exception thrown: Instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca could not be found. Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Request method failure captured: Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: request: GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca HTTP/1.1 Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept: application/json Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Accept-Encoding: identity Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Connection: close Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Length: 0 Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Content-Type: application/json Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Host: 10.222.0.17 Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Openstack-System-Scope: None Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: User-Agent: python-urllib3/1.26.10 Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Auth-Token: gAAAAABi33fKeVs5l0dkTpn59zGzUfuopBe9L0tMNdQ_X9quBbhUSmzQMyuuheYozxHvF0yR8M10PBw77T730a5wUYl9_aqsRxYisb4qTlS3LDQ2XO34GlM7CBusHP5qOTVZV-lpWY5GcAkvYMD0nzV5_iJ4i-_8V91cD11w8O6cJTCx4TY455E Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Id: None Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Domain-Name: None Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Identity-Status: Confirmed Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Is-Admin-Project: True Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Id: default Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Domain-Name: Default Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Id: 1ef8f9da4d8148aebe552f9733dbc45a Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Project-Name: tempest-VolumesSnapshotTestJSON-802793931 Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Role: member,reader Jul 26 05:13:34.718676 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Roles: member,reader Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ef8f9da4d8148aebe552f9733dbc45a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ef8f9da4d8148aebe552f9733dbc45a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ef8f9da4d8148aebe552f9733dbc45a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ef8f9da4d8148aebe552f9733dbc45a"}]}] Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant: tempest-VolumesSnapshotTestJSON-802793931 Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Id: 1ef8f9da4d8148aebe552f9733dbc45a Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-802793931 Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User: tempest-VolumesSnapshotTestJSON-802793931-project Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Id: default Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Domain-Name: Default Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Id: 832161ae82a74a03b6ad578386ed0bb4 Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: X-User-Name: tempest-VolumesSnapshotTestJSON-802793931-project Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: method: > Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: exception: Instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca could not be found. Jul 26 05:13:34.720378 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: action_args: {'id': 'ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca'} Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca could not be found. Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:13:34.721274 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca could not be found. Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca could not be found. Jul 26 05:13:34.722701 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: ERROR nova.api.openstack.wsgi Jul 26 05:13:34.723965 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Returning 404 to user: Instance ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca could not be found. {{(pid=117994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:13:34.723965 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-1ca94123-3aa3-4661-8345-d5faa499be24 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca" status: 404 len: 111 microversion: 2.1 time: 0.037853 Jul 26 05:13:34.723965 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 540/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:34 2022] GET /compute/v2.1/servers/ba1e8858-e8e8-4ff3-b6df-3078b4f7eeca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:13:42.602920 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-665314752", "imageRef": "04ddee73-9c72-461b-89b0-ac3f57014184", "flavorRef": "452", "networks": [{"uuid": "f3941d81-f5ed-4186-b07a-def8af852774"}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:13:42.657183 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] validate_networks() for [('f3941d81-f5ed-4186-b07a-def8af852774', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 05:13:43.067938 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 05:13:43.068354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 05:13:43.068854 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 05:13:43.069263 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 05:13:43.069663 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 05:13:43.080460 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:43.080986 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:43.081783 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:43.082217 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:43.099541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Getting quotas for project 1ef8f9da4d8148aebe552f9733dbc45a. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 05:13:43.104146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Getting quotas for user 832161ae82a74a03b6ad578386ed0bb4 and project 1ef8f9da4d8148aebe552f9733dbc45a. Resources: {'cores', 'instances', 'ram'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 05:13:43.116458 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 05:13:43.118692 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04ddee73-9c72-461b-89b0-ac3f57014184',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 05:13:43.163683 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-06ed8a0e-d36d-44d8-b456-9ac809ca16bf tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564704 Jul 26 05:13:43.164343 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 521/1061] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Jul 26 05:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 05:13:43.175392 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-9faff60f-b48d-4fb2-8e5c-81c4fd62bac3 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:43.176649 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-9faff60f-b48d-4fb2-8e5c-81c4fd62bac3 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:43.231170 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-9faff60f-b48d-4fb2-8e5c-81c4fd62bac3 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:43.240858 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-9faff60f-b48d-4fb2-8e5c-81c4fd62bac3 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1218 microversion: 2.1 time: 0.069448 Jul 26 05:13:43.241422 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 541/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:43 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:44.263621 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:44.264621 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:44.275523 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:44.276339 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:44.277677 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:44.278450 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:44.356623 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:44.364376 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f3e578cc-424f-4632-959d-31a0033140ec tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1276 microversion: 2.1 time: 0.106244 Jul 26 05:13:44.364944 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 522/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:44 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 05:13:45.385894 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:45.386672 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:45.390757 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:45.394424 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:45.394872 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:45.395680 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:45.396108 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:45.567426 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-18d46596-bede-49c5-9f36-377a1cad85ab req-746882d2-69ae-4e30-a6ad-edafe8d209f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3581268-fae9-45f7-80f5-0875da66b643", "tag": "0ceb12f8-c7e4-4dd6-a458-dcb296154b47"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:13:45.578545 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-18d46596-bede-49c5-9f36-377a1cad85ab req-746882d2-69ae-4e30-a6ad-edafe8d209f8 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:45.579467 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-18d46596-bede-49c5-9f36-377a1cad85ab req-746882d2-69ae-4e30-a6ad-edafe8d209f8 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:45.590669 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-18d46596-bede-49c5-9f36-377a1cad85ab req-746882d2-69ae-4e30-a6ad-edafe8d209f8 service nova] Creating event network-changed:0ceb12f8-c7e4-4dd6-a458-dcb296154b47 for instance a3581268-fae9-45f7-80f5-0875da66b643 on hv-cinder-85057 Jul 26 05:13:45.596110 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-18d46596-bede-49c5-9f36-377a1cad85ab req-746882d2-69ae-4e30-a6ad-edafe8d209f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032971 Jul 26 05:13:45.596571 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 523/1064] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:13:45.615434 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:45.623537 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-79276112-883b-4213-acc0-aef5f0626eea tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1318 microversion: 2.1 time: 0.241727 Jul 26 05:13:45.624138 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 542/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:45 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:46.651063 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:46.652128 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:46.661702 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:46.662151 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:46.662921 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:46.663354 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:47.161898 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:47.170403 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8ad61526-5933-41ea-a02d-fb1ffe50571c tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1318 microversion: 2.1 time: 0.527361 Jul 26 05:13:47.170991 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 524/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:46 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:48.196886 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:48.197957 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:48.209425 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:48.209928 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:48.211208 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:48.212173 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:48.355776 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:48.365560 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-de07a620-0da9-4aee-94fc-9999bf55b758 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1318 microversion: 2.1 time: 0.175574 Jul 26 05:13:48.366118 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 543/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:48 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:49.388044 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:49.388707 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:49.396822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:49.397280 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:49.398047 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:49.398489 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:49.529216 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:49.536839 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e66bd952-0f9d-4340-9ac7-b76d2e5ff992 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1318 microversion: 2.1 time: 0.153489 Jul 26 05:13:49.537756 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 525/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:49 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:50.565186 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:50.566196 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:50.577304 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:50.578052 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:50.579320 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:50.580098 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:50.718288 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:50.729698 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-c9dc4173-d669-41fb-a7f2-5e1f4f2fd324 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1318 microversion: 2.1 time: 0.171165 Jul 26 05:13:50.730548 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 544/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:50 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:51.149833 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-f957ab18-3893-4d27-8338-aa35669795cb req-4e51f9c3-5ace-409a-94bd-48c459464e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3581268-fae9-45f7-80f5-0875da66b643", "name": "network-vif-plugged", "status": "completed", "tag": "0ceb12f8-c7e4-4dd6-a458-dcb296154b47"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:13:51.160632 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-f957ab18-3893-4d27-8338-aa35669795cb req-4e51f9c3-5ace-409a-94bd-48c459464e35 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:51.161064 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-f957ab18-3893-4d27-8338-aa35669795cb req-4e51f9c3-5ace-409a-94bd-48c459464e35 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:51.171988 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-f957ab18-3893-4d27-8338-aa35669795cb req-4e51f9c3-5ace-409a-94bd-48c459464e35 service nova] Creating event network-vif-plugged:0ceb12f8-c7e4-4dd6-a458-dcb296154b47 for instance a3581268-fae9-45f7-80f5-0875da66b643 on hv-cinder-85057 Jul 26 05:13:51.176986 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-f957ab18-3893-4d27-8338-aa35669795cb req-4e51f9c3-5ace-409a-94bd-48c459464e35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031150 Jul 26 05:13:51.177578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 526/1070] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:13:51.754706 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:51.755645 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:51.762711 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:51.763163 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:51.763976 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:51.764408 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:51.903946 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:51.914469 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0dc89756-4093-444c-bccf-be6194c13d3b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1318 microversion: 2.1 time: 0.166589 Jul 26 05:13:51.915058 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 545/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:51 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:52.941826 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:13:52.942971 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:52.953541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:52.954281 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:52.955522 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:52.956289 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:53.088331 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:53.094624 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:13:53.102327 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3eabbb9a-f35a-4002-960b-d7e4b22efe6b tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1506 microversion: 2.1 time: 0.168925 Jul 26 05:13:53.102898 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 527/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:13:52 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:13:53.123544 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-4fe3d48d-288e-4574-a364-71a555beee23 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aaac1b0-f08f-4409-9110-b4aa3942e8d2", "device": "/dev/sdb"}} {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:13:53.126448 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-4fe3d48d-288e-4574-a364-71a555beee23 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:13:53.133152 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fe3d48d-288e-4574-a364-71a555beee23 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:53.133601 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fe3d48d-288e-4574-a364-71a555beee23 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:53.134364 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fe3d48d-288e-4574-a364-71a555beee23 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:13:53.134794 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-4fe3d48d-288e-4574-a364-71a555beee23 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:13:53.235816 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell0:SELECT=2 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:13:53.396739 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-4fe3d48d-288e-4574-a364-71a555beee23 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "POST /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276366 Jul 26 05:13:53.397674 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 546/1073] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Jul 26 05:13:53 2022] POST /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:14:11.904722 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:14:11.905285 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:14:11.907074 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:14:11.908350 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:14:11.909331 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:14:11.915578 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:11.916037 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:11.916781 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:11.917207 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:12.002994 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lazy-loading 'services' on Instance uuid a3581268-fae9-45f7-80f5-0875da66b643 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:14:12.093062 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aa1eb85a-5b1e-4fbd-83a1-7f0701a43809 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643/os-volume_attachments/0aaac1b0-f08f-4409-9110-b4aa3942e8d2" status: 202 len: 0 microversion: 2.1 time: 0.191841 Jul 26 05:14:12.093824 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 528/1074] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Jul 26 05:14:11 2022] DELETE /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643/os-volume_attachments/0aaac1b0-f08f-4409-9110-b4aa3942e8d2 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 05:14:13.223814 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_api:SELECT=22 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:14:13.224703 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG dbcounter [-] [117994] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:14:13.228826 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:14:13.229419 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:14:13.237286 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:13.237728 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:13.238482 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:13.238916 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:13.264398 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Going to try to terminate instance {{(pid=117994) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 05:14:13.346578 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-5196b1e1-fe6d-4a12-8c68-e74d4945d039 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 204 len: 0 microversion: 2.1 time: 0.123949 Jul 26 05:14:13.347173 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 547/1075] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Jul 26 05:14:13 2022] DELETE /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 05:14:13.358625 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:14:13.359195 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:14:13.366888 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:13.367424 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:13.368228 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:13.368652 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:13.509830 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:14:13.517680 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a18b9b55-f9c2-406d-9069-da6898a6f58a tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1512 microversion: 2.1 time: 0.165000 Jul 26 05:14:13.518251 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 529/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:14:13 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:14:14.543725 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:14:14.544872 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:14:14.556056 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:14.556799 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:14.558064 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:14.558780 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:14.702253 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:14:14.710076 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-0333edb1-d25b-43be-a1ce-b413274a4273 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1512 microversion: 2.1 time: 0.173569 Jul 26 05:14:14.710644 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 548/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:14:14 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:14:15.619949 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-89e9a7ee-2765-4628-893a-68c28f04310a req-8e9e98cc-4e9e-427b-89a9-82d935927782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3581268-fae9-45f7-80f5-0875da66b643", "name": "network-vif-deleted", "tag": "0ceb12f8-c7e4-4dd6-a458-dcb296154b47"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 05:14:15.632315 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-89e9a7ee-2765-4628-893a-68c28f04310a req-8e9e98cc-4e9e-427b-89a9-82d935927782 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:15.632750 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-89e9a7ee-2765-4628-893a-68c28f04310a req-8e9e98cc-4e9e-427b-89a9-82d935927782 service nova] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:15.645140 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-89e9a7ee-2765-4628-893a-68c28f04310a req-8e9e98cc-4e9e-427b-89a9-82d935927782 service nova] Creating event network-vif-deleted:0ceb12f8-c7e4-4dd6-a458-dcb296154b47 for instance a3581268-fae9-45f7-80f5-0875da66b643 on hv-cinder-85057 Jul 26 05:14:15.657659 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-89e9a7ee-2765-4628-893a-68c28f04310a req-8e9e98cc-4e9e-427b-89a9-82d935927782 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041126 Jul 26 05:14:15.658364 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 530/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jul 26 05:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 05:14:15.730553 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.api.openstack.wsgi [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:14:15.731203 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.compute.api [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117994) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:14:15.739039 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:15.739637 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:15.740407 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:15.740842 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:15.774350 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:15.774781 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG oslo_concurrency.lockutils [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:15.776010 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.objects.instance [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lazy-loading 'fault' on Instance uuid a3581268-fae9-45f7-80f5-0875da66b643 {{(pid=117994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 05:14:15.819817 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: DEBUG nova.policy [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '832161ae82a74a03b6ad578386ed0bb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef8f9da4d8148aebe552f9733dbc45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117994) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 05:14:15.827980 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO nova.api.openstack.requestlog [None req-3d2193b7-4ce1-4468-a15f-f6cca9e847ad tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 200 len: 1308 microversion: 2.1 time: 0.101329 Jul 26 05:14:15.828555 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: [pid: 117994|app: 0|req: 549/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:14:15 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 05:14:16.851284 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 05:14:16.851905 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] [instance: a3581268-fae9-45f7-80f5-0875da66b643] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 05:14:16.859146 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:16.859588 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:16.860387 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 05:14:16.860822 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Lock "81272727-2a60-4ee7-8404-1f09619562b8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 05:14:16.874478 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] HTTP exception thrown: Instance a3581268-fae9-45f7-80f5-0875da66b643 could not be found. Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Request method failure captured: Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 HTTP/1.1 Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept: application/json Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Connection: close Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Length: 0 Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Content-Type: application/json Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Host: 10.222.0.17 Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi33fKeVs5l0dkTpn59zGzUfuopBe9L0tMNdQ_X9quBbhUSmzQMyuuheYozxHvF0yR8M10PBw77T730a5wUYl9_aqsRxYisb4qTlS3LDQ2XO34GlM7CBusHP5qOTVZV-lpWY5GcAkvYMD0nzV5_iJ4i-_8V91cD11w8O6cJTCx4TY455E Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Id: 1ef8f9da4d8148aebe552f9733dbc45a Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesSnapshotTestJSON-802793931 Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Role: member,reader Jul 26 05:14:16.876133 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ef8f9da4d8148aebe552f9733dbc45a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ef8f9da4d8148aebe552f9733dbc45a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ef8f9da4d8148aebe552f9733dbc45a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ef8f9da4d8148aebe552f9733dbc45a"}]}] Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesSnapshotTestJSON-802793931 Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 1ef8f9da4d8148aebe552f9733dbc45a Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-802793931 Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesSnapshotTestJSON-802793931-project Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Id: 832161ae82a74a03b6ad578386ed0bb4 Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesSnapshotTestJSON-802793931-project Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: method: > Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: exception: Instance a3581268-fae9-45f7-80f5-0875da66b643 could not be found. Jul 26 05:14:16.878035 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: action_args: {'id': 'a3581268-fae9-45f7-80f5-0875da66b643'} Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3581268-fae9-45f7-80f5-0875da66b643 could not be found. Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 05:14:16.879051 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3581268-fae9-45f7-80f5-0875da66b643 could not be found. Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3581268-fae9-45f7-80f5-0875da66b643 could not be found. Jul 26 05:14:16.880765 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Jul 26 05:14:16.882239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] Returning 404 to user: Instance a3581268-fae9-45f7-80f5-0875da66b643 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 05:14:16.882239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b48ca3f9-e427-4127-b141-67919ac0c672 tempest-VolumesSnapshotTestJSON-802793931 tempest-VolumesSnapshotTestJSON-802793931-project] 10.222.0.17 "GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643" status: 404 len: 111 microversion: 2.1 time: 0.030708 Jul 26 05:14:16.882239 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 531/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Jul 26 05:14:16 2022] GET /compute/v2.1/servers/a3581268-fae9-45f7-80f5-0875da66b643 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 05:14:46.995087 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:14:46.995781 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Tue Jul 26 05:14:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:15:07.562907 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:15:07.563861 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Tue Jul 26 05:15:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:15:16.968565 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:15:16.969488 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Tue Jul 26 05:15:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:17:22.001677 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:17:22.002643 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Tue Jul 26 05:17:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:17:24.690386 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:17:24.691190 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Tue Jul 26 05:17:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:18:07.004774 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:18:07.005448 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Tue Jul 26 05:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:18:27.576661 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:18:27.577541 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Tue Jul 26 05:18:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:18:36.981778 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:18:36.982690 dv-cinder-850574-1-iscsi devstack@n-api.service[117994]: Tue Jul 26 05:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 05:18:43.953975 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:18:43.954823 dv-cinder-850574-1-iscsi devstack@n-api.service[117993]: Tue Jul 26 05:18:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!